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ABSTRACT 

An evaluation is made of the efficacy of various 
approaches to early childhood education when tested in the natural 
laboratories of operating schools, and the Follow Through program’s 
impact on achieving social changes and ameliorating effects of 
poverty through education. Judged primarily from data collected 
during the 1969-70 school year. Follow Through is achieving its 
intended objectives. Some of the major findings of the program 
evaluation are: (1) Effects of Follow Through participation on 

children, parents, and school staff are not identical from one 
Stjonsored approach to another; (2) Children at all grade levels in 
Follow Through showed greater gains in school achievement than d 
their non-Follow Through counterparts; (3) Follow Through ch' 
showed positive changes in their attitudes toward school, th ■’t- 
teachers, and their classmates; (4) Parents of Follow Through 
children showed consistently higher levels of awareness of their 
children’s school program; were more likely to visit school; tended 
to be somewhat more satisfied with their child’s school; and regarded 
the school’s program as being more efficacious; and (5) Teachers and 
other school staff generally viewed the program as very helpful to 
the children and as influencing their teaching practices and 
attitudes. There are 8 chapters, 8 numbered appendices, 12 
illustrations, and 31 tables in this report. For Appendix A, 
Statistical Data, see ED 057 267. (DB) 
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DRAFT 





PREFACE 



The ultimate goal of Follow Through is to increase the opportunities 
for poor children to have self-confident, productive, constructive lives. 
The Follow Through program was established through the U.S. Office of 
Education and the Office of Economic Opportunity to sustain and supple- 
ment in the early grades the gains made by low income children who have 
3 full year’s experience in a Head Start or comparable preschool program. 
The program is administered by the U.S. Office of Education under a dele- 
gation of authority from the Office of Economic Opportunity. \ 

The environment in which a child lives and the persons with whom 
the child interacts all affect the child in complex ways to influence 
his development and his life chances. Because of these complex personal, 
social, and environmental interactions, the Follow Through program has 
many components, as described in the Background section of this report. 

This document is a progress report on SRI activities in support of 
the total Follow Through program. Selected data are provided in a sepa- 
rate volume. Appendix A. Extensive data on specific evaluation tasks 
have been provided to the Follow Through Program of the U.S. Office of 
Education. 
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PRECIS 



Two basic issues dominate the evaluation of Follow Through. The 
experimental issue concerns the efficacy of various approaches to early 
childhood education when tested in the natural laboratories of operating 
schools. The policy issue revolves around the questions of achieving 
social changes and ameliorating impacts of poverty through education. 

Bald statements about these complex and pressing issues can be made 
but not proven by data based on one school year. On the experimental 
question, it will be possible to detect, measure, analyze, and present 
for judgment the consequences of different approaches as revealed in 
children's behavior and beliefs, in the practices and attitudes of teach- 
ers, and in the reactions and feelings of families and the larger commu- 
nity. Determining the relative effectiveness of different approaches 
implies an ability to (1) describe the operations of each, (2) perceive 
and measure differences among them, and (3) assess the importance of 
differences in their operations and in their consequences. 

This report presents the existing evidence, with occasional bewilder 
ing contradictions. Verdicts should be deferred, therefore, even though 
some trends are evident now. Data from the 1969-70 school year provide 
some clear indications that the experimental models in Follow Through 
(1) operate differently fr’om one another, (2) have constituencies of 
different sizes and degrees of enthusiasm, and (3) are associated with 
different effects among children. 

The contradictions and uncertainties in these data are the best 
arguments to support the recommendation that more time is needed to sort 
through, better understand, and ultimately weigh the cumulative evidence 
before rendering judgments abovit the relative effectiveness of different 
Follow Through sponsor models. 

On the social policy issue, the trends seem clear. Follow Through 
is approaching the immediate goals set for it in the authorizing legisla- 
tion. The consequences of participation in Follow Through seen in child 
achievement and attitudes, in parent actions and attitudes, and in the 
processes of instruction are most vivid where Follow Through was intended 
to have its impact — with children and families who are most poor, with 
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children who had experienced Head Start before they entered regular 
school, and with children who receive the full array of Follow Through 
services . 

To the extent that a foundation for learning within the limits of 
individual competence is a necessary, if net sufficient, condition for 
improved life chances, one can speak of so^^ial objectives of Follow 
Through being realized. 

Even though the short run effects are encouraging, a verdict on 
the worth of Follow Through is not possible at this time. The immediate 
questions, such as whether poor children who participate in the program 
are learning more and learning faster can be answered. The extent to 
which these advantages will translate ultimately into improved life 
chances is a question that may never be answered unequivocally and cer- 
tainly cannot be answered in the span of a few years. 

Considered as a whole, and judged primarily from data collected 
during 1969-70, Follow Through is achieving its intended objectives. 

Some of the major findings of the evaluation to date are: 

(1) Effects of Follow Through participation on children, parents, 
and sch ool staff are not identical from one sponsored approach 
to another. It appears, therefore, that the strategy of 
planned variation which gives Follow Through its unique re- 
search and development quality also will yield evidence 
through time from which judgments can be made regarding most 
promising approaches to early childhood education. 

(2) Children at all grade levels in Follow Through showed greater 
gains in school achievement during the school year than did 
their non-P’ollov^ Through counterparts. This was true for al?L 
children combined and was particularly so for those children 
whose families were most poor. Children in kindergarten 
exceeded theii* non-Follow Through counterparts in the absolute 
level of measui'ed achievement reached by the end of the 1969-70 
school year as well as exceeding them in the rate of change 
during the year. 

(3) Follow Through children showed positive changes during the 
1969-70 school year in their attitudes toward school and in 
their feelings about their teachers and classmates. Most of 
these changes were not sigificantly different from those shown 
by non-Follow Through children during the same period. 



(4) In contrast to parents of non-Follow Through children, parents 
of Follow Through children showed consistently higher levels 
of awareness of their children's school program, were more 
likely to visit school and talk to teachers and other staff, 
tended to be somewhat more satisfied with their child's school, 
and reflected a greater sense of efficacy with regard to 
school programs. 

(5) Teachers and other school staff who were involved in Follow 
Through, including paraprofessional aides and assistants, 
generally viewed Follow Through as very helpful to children, 
as a program in which they would like to continue, and as a 
program that has influenced both their instructional practices 
and their feelings about what is desirable and possible. 
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I BAnKGROUND 



Origin and Objectives of Follow Through 

In Docomber 1967 , Congress amended the Econonai c Opportunity Act of 
1964 to establish: 

A program to be known as Follow Through focused primarily on 
the children in kindergarten or elementary school who are pre- 
viously enrolled in Head Start or similar programs and de- 
signed to provide comprehensive services and parent partici- 
pation activities. . . . which the director finds will aid in 
the continued development of children in their full potential. 

Follow Through is a comprehensive program of instruction and services 
for disadvantaged children from kindergarten through third grade. It is 
intended for children of parents who meet the poverty standards of eli- 
gibility established by the Office of Economic Opportunity (OEO).* Follow 
Through s ultxniate aim is to improve the life chances of these children. 

The Follow Through program is administered by the Office of Education 
(OE) , under a delegation of authority from OEO, and requires the- following 
components in each local Follow Through project: 

( 1) An instructional program 

( 2 ) A program sponsor 

( 3 ) Staff training and development programs 

( 4 ) Provision for the use of paid paraprof essionals and volunteer 
workers 

( 5 ) Parent involvement 



The OEO "poverty line" index in force during 1969-70 is reproduced in 
Appendix 1, which also gives the operational definitions of levels of 
poverty that SRI employed in the analyses contained in this report. 



(6) An advisory council, the Policy Advisory Committee (PAC) , which 
must draw over half of its members from parents of Follow Through 
children and play a substantial role in the planning and manage- 
ment of the project 

( 7 ) Participation of community agencies 
(s) Medical and dental services 

( 9 ) A nutritional program 

( 10 ) A social services program 

( 11 ) Guidance and psychological services. 



Growth of Follow Through 



Follow Through began as a pilot program during the school year 
1967-68 with 40 projects reaching approximately 5,000 students in 35 states 
and Puerto Rico. In 1968-69 there were projects in Washington, D,C. , 

Puerto Rico, and every state except Wyoming. There were 104 Follow 
Through projects in 91 geographical places; 47 of these projects were 
included, in the SRI evaluation study sample during 1968-69, By 1969-70, 
the number of projects had increased to 161 in 140 locations and the SRI 
study sample was increased to 8:; projects. All Follow Through projects 
for 1969-70 are listed in Appendix 2. That tabulation also shows the 
data collection activities undertaken in each project during 1968-70. 

The list illustrates how widespread in geographical and urban/rural 
characteristics are the Follow Through projects. No quick summary can 
do full service to the variation among them. However, Follow Through 
projects are most likely to be found in ( l) inner-city neighborhoods of 
large metropolitan areas, ( 2 ) the rural souths ( 3 ) Appalachia, and 
( 4 ) Indian reservations. As with all generalizations, this one is not 
applicable in all cases — witness Burlington, Vermont or Tacoma, Washington 
or Vincennes, Indiana. 



The Concept of Sponsorship and Planned Variation 

Between December 1967 and February 1968, OE convened a series of 
meetings to further develop and refine the Follow Through program. At 
these meetings a strategy of "planned variation" was adopted, whereby 
a variety of approaches to the early education of disadvantaged children 
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was to be employed and tested within Follow Through. The Office of 
Education invited a number of groups that had done significant work in 
early childhood education to submit program models which they were will- 
ing to implement in local projects. Thirteen sponsor models were se- 
lected to be initiated during 1968-69; six more were added during 1969-70. 
A list of sponsors and addresses are provided in Appendix 3.( (One of the 
o^isinal 13 sponsors did not continue and is therefore not included in 
the 1968-69 data shown in Appendix 3.) 



All projects begun after the pilot year have been expected to choose 
a sponsor. The original projects also. were requested to select one; most 
did so, but some projects remain self-sponsored. Also, some projects 
have been planned and governed by parent groups; these are identified as 
parent-implemented , and may or may not have instructional model sponsors. 
The sponsor models are associated with a university or other educational 
organization. 



Similarities and Differences Among Sponsor Models 



The concept of planned variation was not intended as a means of 
finding a single best" method of early education for disadvantaged 
children. A wide variety of poverty areas and disadvantaged populations 
exist, and a program that is appropriate for one may hot be for another. 

To estimate these "program-by-circumstance" interactions, sponsors are 
testing their models in several different locations. Also, many of the 
programs are complementary; for example, some emphasize parental inv'olve- 
ment and community control, while others focus on the curriculum, the 
teacher, and the classroom. 

The sponsor models were selected because they were in some significant 
ways unique. Nevertheless, the sponsors also share areas of common agree- 
ment. All seek to develop the child's academic abilities. All advocate 
such practices as reduced class size and small group and individual in- 
struction, to be achieved by the use of teacher aides and classroom volun- 
teers. All intend that learning be interesting and relevant to the 
student’s environment. The sponsors also believe that the student's com- 
petence in academic skills is inseparable from his self-esteem, motivation, 
sense of autonomy, and confidence in success, and seek ways to achieve 
these affective goals as well as the traditional, academic objectives. 

The sponsors do differ among themselves, however, in the priorities they 
attach to these objectives and in the sequence by which they pursue them. 
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Responsibilities for the Evaluation 



In July 1968, SRI entered a contract to begin the longitudinal evalua- 
tion of the national Follow Through program. Other organizations also 
are participating in the overall evaluation of Follow Through. Bio- 
Dynamics, Inc. , of Cambridge, Massachusetts, is evaluating health services 
(medical, dental, psychological, and nutritional). The NTL Institute for 
Applied Behavioral Science is studying the relationships between Follow 
Through projects and the local school systems and communities in a limited 
number of sites. The sponsors also have their own evaluation programs 
to assess the effectiveness of their models. Finally, many school dis- 
tricts also assess program effects against local objectives. 

This report describes the SRI Follow Through evaluation during its 
first two years. Most of the data reported are drawn from the second 
year, 1969-70. 
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II SUMMARY OF FINDINGS 



The findings of the evaluation to date are presented in five sub- 
sequent sections: (1) the categorization of sponsor approaches and the 

state of their project implementation, (2) effects of program participa- 
tion on teachers and classrooms, (3) effects of program participation on 
home and family, (4) effects of program participation on children, and, 
finally, (5) some interrelationships among these. 

The summary below follows a somewhat modified order. It begins 
with a review of the readiness for the different sponsor approaches to 
be assessed. Following that, the effects of program participation on 
children are discussed, since bringing about desired changes in children 
is the fundamental purpose of each program and of education itself. Fol- 
lowing the discussion of program effects on children, effects on teachers 
and classroom procedures and effects on parents and families are presented 
so that Follow Through program objectives specific to classrooms and homes 
can be examined both independently and in relation to effects on children. 



Sponsors and Projects 

Project Selection 

During 1969-70, 18 models with individual or institutional sponsors 
were testing their approaches in Follow Through. in addition, 16 proj- 
ects were self-sponsored and 7 projects were parent-implemented without 
a secondary affiliation with an instructional model sponsor. For pur- 
poses of project classification, the self-sponsored and parent-implemented 
projects have been grouped as two distinct classes, thus making a total of 
20 models. Six of the 18 sponsored models were new to Follow Through at 
the beginning of the 1969-70 school year. Thus, 12 more or less systematic 
models, plus the two more heterogeneous clusters of self-sponsored and 
parent-implemented projects, represented the number of approaches thought 
to be eligible for a systematic assessment of their processes and outcomes. 

The data collection plan included several individual projects repre- 
senting each approach. Where the number of projects was sufficient to 
permit selection, the projects chosen for the study sample included one 
or two projects that each sponsor considered an exemplar of his approach. 
The study sample excluded some projects where unusual difficulties had 



been encountered in implementation. The final selection included 89 
projects representing the 20 different models. Among the 12 models 
whose performance was of greatest interest since they had had at least 
one year of implementation, the number of projects included in any one 
data collection activity ranged from a minimum of two in the case of 
one established sponsor who had but two projects, to a maximum of eight. 

Evaluation policy, established jointly and agreed upon by the OE/ 
Follow Through program office and SRI, dictates that individual sponsors 
not be contrasted to one another on the basis of outcomes from the first 
full year of program operation following the implementation stage. Such 
contrasts, it has been agreed, would be premature and misleading owing 
to differences among the sponsors on the variety of objectives they 
seek and, among objectives shared by most or all of them, to variations 
in the sequence in which objectives are sought. 



Sponsor Grouping 



For the present report covering Follow Through in the 1969-70 school 
year, the various approaches or models have been grouped into five broad 
classes. One class includes the self-sponsored projects and another in- 
cludes the parent-implemented projects that do not have an affiliation 
with an instructional model. The three sponsored classes (Sponsor Groups 
1, 2, and 3) are described briefly as follows: 

(1) Sponsor Group 1 contains the most highly structured approaches. 
These sponsors make systematic use of stimulus-response and 
reinforcement learning paradigms, rely heavily on behavior 
analysis, use programmed instructional materials, and concen- 
trate on academic and pre-academic skills. 

(2) Sponsor Group 2 approaches follow learning models based on 
inquiry and discovery and seek to impart how-to-learn tech- 
niques rather more than factual substance, particularly in the 
earliest school years. Sponsors in this group emphasize 
humanistic values such as positive feelings of self-worth and 
respect and trust for others. The stimulation of curiosity 
and the encouragement of discovery are particularly prominent 
in approaches in the group. 

(3) Sponsor Group 3 is more heterogeneous in approaches than the 
preceding two. As a whole, these approaches tend to be less 
systematic and more pragmatic, weaving elements from a variety 
of educational theory into coherent models. To characterize 
the approaches in Sponsor Group 3 as "unsystematic” does some 



disservice to them individually but the models included in 
this grouping occupy an intermediate position between the more 
clearly opposing approaches of Groups 1 and 2. 

Considering only the "mature” sponsors, five were classified in 
Group 1, three were classified in Group 2, and four were classified in 
Group 3. When all sponsors involved during 1969-70 are counted, one 
additional sponsor is added to Group 1 and five additional sponsors to 
Group 3. With the exception of one project represented in Group 3 at 
the non-entering first grade level, all the projects on whom both Fall 
and Spring data were obtained in 1969-70 and which, therefore, consti- 
ture the core of the pupil and other measures presented in this report, 
were the mature sponsors and self-sponsored and parent-implemented proj- 
ects that had been involved in Follow Through for at least one year prior 
to 1969-70. 



Project Implementation 

Sponsors were asked to rate and rank each of their projects accord- 
ing to the status of its implementation at the end of the 1969-70 school 
year. Eight of the 12 sponsors responded, thus permitting implementa- 
tion scores to be derived for those of their projects that were under 
study. Seventeen of the 32 projects thus scored were ones in which data 
had been collected both in the Fall and Spring of 1969-70. Thirteen of 
these 17 projects were judged by sponsors to be in the high half of their 
project sets according to their own criteria of status of implementation. 
It may be said with confidence, then, that the majority of the findings 
presented in this report are drawn from projects that are legitimate 
candidates for evaluation according either to the standard of time for 
implementation or each sponsor's own assessment of the project's readiness 

A final note on implementation comes from analyses of classroom 
observations in a subset of projects representing Sponsor Groups 1, 2, 
and 3. These data reflect a high level of implementation insofar as the 
sponsors' expectations that certain classroom characteristics would be 
observed were, in nearly every case, confirmed by independent observation. 
The average implementation score from the observations (based on seven 
projects and 29 Follow Through classrooms) was 85%, where 85% represents 
the battxng average" of confirmed expectations. Clustered into sponsor 
groups, the implementation scores ranged from 827o to 91%. No single 

sponsor was scored below 73% and only one classroom in 29 was scored 
below 50%. 
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Pupil Development 



Two classes of measures were obtained on pupils at both Fall and 
Spring during 1969-70, and a third set of measures were obtained in the 
Spring on some of these children. Measures obtained on all pupils were 
a battery of achievement tests and two attitude scales, one of which 
sought to measure attitudes toward school and learning and the other 
to measure interpersonal feelings (pupil-to-pupil and pupil-to-teacher) . 

The battery of achievement tests used varied in specific content 
from one grade level to another and increased in difficulty with each 
grade level. Broadly, the achievement battery reflected verbal/ 
linguistic skills, quantitative/computational skills, and perceptual/ 
motor skills. Each of these areas in turn contained subclassifications; 
the data presented in this report sum all scores into a single battery 
total . 

Additional measures on a subset of pupils were obtained in a pilot 
study to try out a variety of instruments so that measurement could be 
broadened to include indicators of non~cognitive growth on such qualities 
as school fearfulness, ethnic identity, locus of control, intrinsic and 
extrinsic sources of motivation, generalized school attitudes, and the 
The subset of children on whom these measures were obtained was 
a judgmental sample from only eight projects. Evaluation judgments based 
on these data would be inappropriate due to the character of the samples 
and the provisional nature of some of the instruments. They do, however, 
enrich and expand the protrait of Follow Through and non-Follow Through 
children and suggest some additional differences between the various 
models. 

The findings support the generalizations made in the Precis: 

(1) Some differences between approaches were evident when they 
were grouped into the broad sponsor classes according to their 
goals and instructional practices. This finding leads to the 
confident expectation that different patterns of outcomes 
associated with different approaches will become increasingly 
discernible and accessible to judgment, 

(2) Different patterns of achievement and, to a lesser extent, 
attitude change can be related to a variety of personal and 
family characteristics. 
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The children whose performance is of greatest interest at this 
time in the evaluation of Follow Through are those who (1) were clearly 
poor and therefore eligible for Follow Through on the basis of poverty 
and (2) were in kindergarten and entering first grade. (In some school 
districts, kindergarten is the first year of regular school; in other 
school districts, first grade is considered the entering year.) These 
are the children — both Follow Through and non-Follow Through — to whom 
the immediately following paragraphs apply. In other sections of the 
report, information about other grade levels and about children who 
would not be classified as poverty-eligible for Follow Through on the 
basis of family income and family size also are reported. 



Achievement Outcomes by Sponsor Groupin g s 

Children in the sponsor group whose approach is most structured 
and concentrates most explicitly on developing academic and pre-academic 
skills showed a consistently higher level and rate of achievement mea- 
sured by the pupil achievement test battery. This was true among poor 
children at kindergarten, where Follow Through children began the year 
below their non-Follow Through counterparts and finished the year sig- 
nificantly ahead. It was also true at entering first grade, where a 
similar pattern obtained. 

The pattern was not quite so consistent for Sponsor Groups 2 and 3. 
At both grades in Sponsor Group 2, Follow Through children began and 
ended the year behind their non-Follow Through comparison group. In 
Sponsor Group 3, kindergartners began and ended the year ahead of the 
non-Follow Through children but did not gain as much during the year as 
the non-Follow Through children. At entering first grade, in contrast, 
they began and ended the year behind but gained more than the non-Follow 
Through children during the year. 

No comparisons at the entering first grade would be justified for 
Sponsor Group 4 since only one project represented this sponsor group. 
More projects in Sponsor Group 4 operated at kindergarten level, how- 
ever, and these Follow Through children compared very favorably with 
their non-Follow Through counterparts; they began and ended the year 
ahead and gained significantly more during the year. 



Attitude Changes by Sponsor Groupings 

Measures of children's attitudes toward school showed changes favor- 
Follow Through; these differences approached statistical significance 



at the kindergarten and reached it at entering first grade. The pattern 
from one sponsor group to another, however, was not consistent. At 
kindergarten, none of the sponsor groups displayed statistically signifi- 
cant changes, although in three of the four, the direction of the change 
favored Follow Through. A similar pattern obtained at entering first 
grade where, although three of the four sponsor groups showed shifts 
that favored Follow Through, none were statistically significant. 

The measure of children's attitudes toward others — the interpersonal 
feelings scale — did not show statistically significant differences when 
compared with non-Follow Through at either kindergarten or entering first 
grade. In one sponsor group a significant,' change favoring FolTow Tlhrough 
was identified but this was the cnnly instance in all groups at both grade 
levels where the difference bsTr^sen Follow Through and non—Follow Thrrough 
was significant. 



Changes Relaten to Poverty „ EreschooL Experience, and Servi ces 

Received 

By legislative and progrssm inntent, Follow Through is for poor 
children with pr ference to thos^s who experienced Head Start (or its 
locally defined equivalent) prior to enrollment in regular school. Once 
enrolled in Follow Through, a child may receive the full array of ser- 
vices that the Follow Through guidelines prescribe or he may receive 
only some of them. (For example, the Guidelines permit some participants 
to be drawn from families that do not fall within the OEO poverty index 
but only children from low income families are eligible to receive the 
full range of services.) Thus, level of poverty, type of preschool ex- 
perience, and range of services received constitute three central policy 
variables in the evaluation of Follow Through. 

Against the criterion of achievement in verbal, quantitative, and 
perceptual-motor skills. Follow Through is reaching these intended pro- 
gram objectives. Kindergartners in Follow Through in 1969-70 were sig- 
nificantly superior to their non-Follow Through counterparts both on 
measures of absolute achievement and in the rate at which they gained 
during the year. The greatest differences between Follow Throiigh and 
non-Follow Through kindergartners were among those children who were 
most poor the primary group to which Follow Through is directed. 

Bead Start experience also was related to achievement during 
the kindergarten year. Former Head Start children who participated in 
Follow Through showed significantly greater gains during the kinder- 
garten year of regular school than did former Head Start children who 
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did not participate in Follow Through. Follow Through children who had 
not participated in Head Start also gained more during their first year 
of school than did non-Follow Through children who had not had Head Start. 
Finally, children who received full Follow Through services showed 
greater gains than children who received less than full services. 

The picture presented by the achievement test scores was not quite 
so clear at entering first grade as at kindergarten. At entering first 
grade, Follow Through children began the year behind their non-Follow 
Through counterparts and did not overtake them,, They gained more during 
the year, however, and the difference betiveen Follow Through and non- 
Follow Through in these gains was statistically significant. 

When Follow Through and non~Follow Through children at entering 
first grade were subclassified according to their preschool experience, 
level of poverty, and extent of Follow Through services received, the 
differences between Follow Through and non-Follow Through children were 
not so clearly in favor of children who were Jncsst poor., received full 
services, and entered Follow Through from Head Start. Im all compari- 
sons, these children gained more during the year but only the subgroup 
of children that had experienced Head Start also finished the year at a 
level of measured achievement greater than their non-Follow Through 
comparisons. 

Non-Cognitive Characteristics 

Measures on a variety of non-cognit ive variables were available on 
a selected subset of about 845 children reflecting four sponsor groups. 

The resulting profiles varied across sponsor groups, further supporting 
the expectation that it will become possible to differentiate among the 
approaches as the longitudinal experiment continues. Some features of 
these measures — bearing in mind that the sample was small and did not 
represent all of the Follow Through sponsors — were notable: 

(1) Follow Through children in all approaches showed less fear- 
fulness of school than did the non-Follow Through comparison 
groups. 

(2) Follow Through children in all approaches reflected greater 
concern for intrinsic than extrinsic sources of motivation. 

(3) Follow Through children in all approaches displayed less 
anxiety in a puzzle-solving situation observed by an adult 
with whom they were unfamiliar. 
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(4) Follow Through children at all grade levels in nearly all 
approaches were more likely to be rated high by teachers im 
behavior that wa.e adaptive to classroom learniE^. 

(5) Follow Through criildren at nearly all grade lev'els in all 
apporoaches received higher scores on task competence ijn the 
puzzle-solving sti-uatlon than did the non-Follow Through 
children. 

Differences between approaches were evident on measures of Inter- 
nalfzed acceptance of responsibility for success and failasrre and on 
attrczudes toward school. 



Homgs and Families 



Many differences between Follow Through and non-FoELow Through 
fanniTies were identified through interviews duxnng 1969-vU;. 

All Follow Through approaches seek to increase the Kxtent to which 
paarents become aware of and involved in school activities that affect 
their children. The evidence is unequivocal that progress is being made 
toward these objectives. Follow Through parents consistently exceeded 
parents of non-Follow Through children in their awareness of classroom 
activities, their contacts with school personnel, their visits to the 
school or classroom, their talks with teachers and other school staff, 
and their general satisfaction with the child’s school. In addition. 
Follow Through parents tended to report a greater sense of influence on 
school programs, or a feeling that their ideas matter to those who run 
the schools. Finally, Follow Through parents were more likely than non- 
Follow Through parents to be active in clubs or organizations not related 
to the schools. 

While it is true that Follow Through parents exceeded non-Follow 
Through parents on all the measures mentioned above and that most differ- 
ences were statistically significant, the extent of absolute difference 
often appeared to be small. For example, about half of all the Follow 
Through mothers reported visiting their child's classroom during the year. 
While this may seem disappointing to advocates of Follow Through parent 
Participation in classrooms, barely 40% of the non-Follow Through parents 
had visited their child's classroom at all and among these parents, the 
average number of visits was less than among Follow Through parents. 
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Despite the fact that many differences were identified between 
Follow TIhrough and non-Follow Through parents, there are= not yet clear 
indications that these differences are correlated signi£icantly with 
children’s achievement or their attitudes about school. Attempts to 
es^:ahlis;lh such relationships with the data from 1969-70 were disappoint- 
ing. Based on the 1969-70 information, it is not possi; le to identify 
obviorus and consistent associations betv^een pai^ent b<eh£?" lor and child 
performance despite the fact that desirable consequences of Follow Through 
participation are being displayed by bcJth parents and children. 



Poverty and its concomitants are ponverful correlates of both family 
lire styles and children's behavior. Family life styles (e.g., the 
number and kind of mutual help relationships between parent and child) 
differ according to level of poverty for both Follow Thiratiigh and non- 
Follow Through parents. When level of poverty is held cranstant, no 
clear differences are evident between Follow Through and non-Follow 
Through families. However, when poverty is held constant, there are 
detectable differences, and statistically significant ones, between 
Pollow Through and non-Follow Through children in their school perfor- 
mance. For example, the greatest differences between Follow Through and 
non-Follow Through children in measured achievement tend to occur among 
these children who are most poor. 



To conclude it would be premature, but it appears that the influ- 
ence of Follow Through on children's performance in school is affecting 
some of the conventional patterns of association between poverty and 
school performance. Over the longer term, as cumulative data become 
available on the same children and families, one may hope that more 
systematic relationships linking Follow Through involvement to both life 
style variables and children's performance in school may be identified. 
For the present, the observed differences between Follow Through and 
non-Follow Through parent and family characteristics must be defended as 
desirable in their own terms and not because of their demonstrated rela- 
tionship to children's school achievement. 



Teachers and Classrooms 



The data from 1969-70 provide some important linkages between the 
activities of Follow Through sponsors, the processes followed in the 
classroom, and the performance of children. The classroom observation 
procedure was found useful in characterizing classroom processes and, 
as already mentioned, showed clearly that the intended processes were 
being implemented in nearly all the classes observed. 
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The kinds of activities that v'ere most prominent in these class- 
rooms are consistent with the patterns of pupil performance that were 
idifentified. Children from classrooms in which the greatest attention 
wai;s given to pre-academic and academic skills showed the greatest gains 
in achievement during the year. Classrooms in which special emphases 
wejre given to exploratory behavior and questioning were more likely to 
characterized by pupils asking more questions, being more open with 
aduiits, and interacting more with materials. 

It is not economically feasible to observe several hundred class- 
rooms for sufficiently long periods to characterize the instructional 
processes that are followed and the beliefs and assumptions that underlie 
teachers behavior and their use of materials. For that reason, a com— 
pl-ementary approach to describing classroom process was attempted through 
self-report questionnaires from teachers. A full analysis of these data 
is not yet complete. Preliminary evidence suggests, however, that the 
two approaches direct observations and self-report surveys — complement 
one another usefully and provide increasingly reliable and valid means 
for characterizing classrooms according to process variables. 

The survey responses from teachers do suggest some differences 
among the approaches in the likelihood that they will be embraced with 
enthusiasm by teachers. Generally, all Follow Through teachers were 
complimentary toward Follow Through and expressed satisfaction with the 
kind and degree of support that the sponsors were providing. There were 
among teachers according to sponsor group, however. For 
example, a higher proportion of teachers in Sponsor Group 1 than in other 
sponsor groups saw much advantage to teaching in Follow Through. At the 
same time, however, a higher proportion of teachers in Sponsor Group 1 
were more likely to see disadvantages to teaching in Follow Through or 
were unwilling to commit themselves ( don’t know") . The proportions of 
teachers in both Sponsor Groups 2 and 3 were similar to each other and 
different from Sponsor Group 1 teachers— —they were somewhat less likely 
to see great advantages in teaching in Follow Through but also less 
likely than teachers in Sponsor Group 1 to see disadvantages. These 

although suggestive, fell short of statistical significance. 

A related pattern was noted among teachers according to grade. Con- 
sistent with the emphasis in 1969—70 on the entering grades as the most 
important ones in the longitudinal experiment, teachers of kindergarten 
and, to only a slightly lesser extent, teachers of entering first grade 
were more likely than teachers of higher grades to see muoh advantage 
to teaching in Follow Through. These differences by grade level, al- 
though encouraging because of their consistency with progi’am emphasis, 
also fell just short of statistical significance. 
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Follow Through teachers differed from iion-Follow Through teachers 
in many ways. Although clear relationships between these characteris- 
tics and children's performance are not yet apparent, as a group Follow 
Through teachers tended to be somewhat younger, less likely to hold 
tenured status, to have taught for fewer years, and less likely to hold 
the highest level of certification. They were not different, however, 
in their academic background or the proportions from ethnic minorities. 

All of the Follow Through approaches are demonstrating effects on 
teachers, both through changed practices and changed perceptions of what 
is possible and desirable. For example. Follow Through teachers are 
more likely than non-Follow Through teachers to assign high importance 
to such activities as home visits by the teacher or other school person- 
nel and to concede a value in direct parent participation as classroom 
volunteers and aides. The effects of Follow Through on specific instruc- 
tional practices are closely related to the style of the program in which 
the teachers participate. Each program sponsor has influenced the teach- 
ing style and practices of teachers who are implementing the various 
models but the specific influences are as diverse as the approaches them- 
selves. Generally, however. Follow Through teachers show markedly greater 
satisfaction with the progress their pupils are making than do non-Follow 
Through teachers at the same grade levels. 
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Ill THE PLAN AND PROCEDURES OF THE FOLLOW THROUGH EVALUATION 



Aims and Purposes of the Evaluation 



The ultimate purpose of the longitudinal evaluation of Follow Through 
is to develop evidence to help guide policy decisions about the design 
and implementation of educational and social programs intended to ame- 
liorate the impact of poverty on the development of young children. 

Broadly, the evaluation seeks to identify and describe the effects 
of program processes upon people and institutions as the program operates 
in particular environmental settings. The primary focus of the Follow 
Through evaluation is upon the child, since the program exists to in- 
crease his chances for a productive, self-confident and constructive life. 
But the evaluation also gives extensive consideration to elements in the 
child's environment that influence his development: his family, his 

neighborhood and community setting, as well as his school. The strength 
of Follow Through's belief in the importance of these elements is demon- 
strated by the variety and comprehensiveness of the services required 
within any one program and insistence that parents and community residents 
participate in policy making and program management. 

Since the child learns and grows in an interdependent system com- 
prised of home, school, and community, the evaluation seeks to identify 
and obtain information about the influence of all these elements on the 
development of the child, A specific goal of the evaluation is to dis- 
cover those factors in both the program and the environment that are 
associated with the outcomes and thereby to identify those programs and 
practices that merit dissemination and possibly wider adoption. 

The full scope of Follow Through, and of the evaluation, may be 
appreciated best if the program is perceived not only as an experiment 
in early childhood education, but also as an effort to induce the social 
changes that will reinforce and amplify the educational efforts so that 
they may succeed and persist. 

In terms of its origins and funding, Follow Through is one of the 
community action programs of the Economic Opportunity Act. The Follow 
Through program seeks to bring about changes not only in the children 
but also in adults and institutions, in the belief that if the program 
is to achieve lasting effects, teachers, schools and the community will 



have to change. It is the task of the evaluation to identify the changes 
that occur as a result of Follow Through, and to discover the means by 
which they come about. 

The evaluation considers the Follow Through program on three levels. 
First, since Follow Through is a federally funded program that provides 
specific instructional and social services and methods of implementing 
them, its effectiveness must be evaluated in terms of the goals of the 
legislation that established it. The central questions at this level 
include: 

(1) Are poor children benefiting from participation in Follow 
Through? 

(2) Are the benefits of participation related to the kind and 
extent of Follow Through services received? 

(3) Does participation in Follow Through reinforce and extend the 
benefits of prior participation in Head Start? 

Second, on the level of the sponsor models, Follow Through's strategy 
of planned variation seeks to test the relative efficacy of a variety of 
somewhat different social and educational programs in the natural labor- 
atories of communities throughout the country so as to develop and iden- 
tify innovations in methods of improving early education that deserve 
wider adoption. Here, the essential issues revolve around the differen- 
tial effects of participation in one program approach or model in con- 
trast to others. 

Third , both the national program and the sponsor models become modi- 
fied in the process of being implemented in the unique socio-cultural- 
political context of each local project. As a result, the evaluation 
also considers each local project as a distinct educational experiment. 

On this level, the task of the evaluation is to develop information use- 
ful in judging the extent to which Follow Through is bringing about 
desirable changes in students, adults, and instutional arrangements at 
the local level. 
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The Strategy and Design of the Evaluation 



The Follow Through program that is being evaluated cosists of: 

(1) The Follow Through Guidelines which state both the elements 
that must be provided in each Follow Through project and the 
overall goals and objectives of Follow Through. 

(2) A set of project planners and implementers — the sponsors — who 
have designed educational approaches to meet the requirements 
of the Follow Through program. Collectively, the sponsors’ 
programs embody a wide range of alternative approaches for 
achieving the objectives of Follow Through, Furthermore, the 
sponsors prepare detailed programs and teaching materials, 
train and provide continuing assistance to teachers, and work 
with school districts in which these approaches are to be imple- 
mented . 

(3) A set of school districts that wish to participate in the Fol- 
low Through program under the conditions Follow Through has 
stated for such participation. These districts include many 
areas across the country in which poor children live. 

(4) A selection process in which alternative approaches are pre- 
sented to the school districts who ' then select, with OE/Follow 
Through staff guidance, the sponsor whose approach they wish 
to have implemented in their district. 

(5) A selection process within school districts in which the schools, 
teachers, and children who are to participate in Follow Through 
are identified by the school district. 

The Follow Through evaluation begins at the end of the foregoing 
steps which are designed to assure that highly motivated sponsors and 
receptive districts have been paired and agree on the broad goal of pro- 
ducing excellent educational programs. 
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The first year of any sponsor's participation in Follow Through, and 
usually his first year in a new school district, are viewed as implemen- 
tation years. Summative evaluation is unjustified during this period be- 
cause too many changes are likely to be made as implementation procedures 
are refined. 

The different sponsors have different objectives that they wish to 
achieve at different times. A one-yoar evaluation period could not serve 
as a means of comparing sponsors on <jssentially the same objectives since 
some sponsors expect to achieve certain goals more quickly than others. 

To reduce disagreement on goals, the period of the evaluation is de- 
fined to be the duration of Follow Through for each group of children. 

For children entering school and Follow Through at first grade, this period 
is thi'ee years; for those entering at kindergarten, the period is four years 
The first such "cohort" began with children entering school and Follow 
Through in 1969-70. For that cohort, the design is before-after with 
"before" occurring in autumn 1969 and "after” occurring in late Spring 
1972. The second cohort began in Fall 1970. 

Children in relatively few districts were tested in .Spring 1970, both 
because of the high cost of testing and because it was an intermediate 
year for both cohort groups. Hence, this report is essentially a progress 
report on the Follow Through evaluation and no comparison of individual 
sponsors is made. 

The non— random choices of districts and allocation of districts 
among sponsors essentially implies that any between-district variance 
is likely to have biases of unknown size and direction. Also, each dis- 
trict xs in a sense a local society; many variables depend essentially 
on the socioeconomic and administrative conditions prevailing in that 
district. Hence, it seemed I’easonable to require that comparison groups 
be selected for each district and that conclusions be largely based on 
intra-district comparisons. 

Within districts, the allocations of schools, teachers, and children 
to Follow Through are made prior to thi evaluation, .^^ny choice of children 
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for purposes of comparison must be from those not elected for Follow 
Through. Since it appeared reasonable that the chances would be high that 
Follow Through would affect non-Follow Through teaching within the i^ame 
schools as those in the Follow Through program, comparison classrooms are 
selected from schools not previously selected for the Follow Through pro- 
gram. Especially in smaller communities but to some extent in all commu- 
nities, this means that it is impossible to simulate either stratified 
random selection or overall random selection. Thus, within each district, 
the analysis must deal with a quasi-experiment. 

Goals and Standards 



The evaluation design seeks to identify changes brought about by 
the Follow Thro\igh program. In order to assess program effectiveness, it 
is necessary to measure these changes against the goals of the program. 

The SRI staff has thus far taken the pragmatic position that intended 
program outcomes or objectives are to be accepted as stated by the pro- 
gram proponents. However, problems in formulating the goals against which 
to judge the changes derive from at least two sources. 

The first is the fact that the Follow Through program includes not 
one but many varied sets of goals. Within the goals of the national 
program, each sponsor has objectives that differ to some extent from 
those of the other sponsors, and the goals of the local projects also 
vary from place to place. The SRI evaluation seeks to comprehend all 
of these objectives, identifying the aims of various stakeholders in 
Follow Through and determining whether the most salient aims of each are 
being achieved. Further, the evaluation seeks to measure unintended as 
well as intended effects. The evaluation plan remains flexible in order 
to incorporate the changes in objectives that occur over time. 

The second source of difficulty in formulating goals and assessing 
change is that stakeholders in Follow Through state their objectives on 
many levels and in different terms. The overall aim of Follow Through, 
for example, may be stated broadly as ''improving the life chances of 
children of poverty." This goal is long-range, general, abstract, and 
societal; it must be translated into shorter term and more concrete in- 
structional and social objectives to permit an assessment of ' the extent 
to which the program achieves it. In addition, the more immediate, con- 
crete objectives also must be restated in terms that identify acceptable 
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evidence of their achievement. As a result, a lengthy process of rede- 
fining and restating objectives has become a part of the Follow Through 
evaluation. 



Quasi-experimental Character of the Evaluation 

As indicated above, the operational requirements of the Follov/ 
Through program limit the choice of evaluation design. Randomization has 
not occurred in the assignment of students, teachers, classrooms, schools, 
or projects. The school districts nominated to receive Follow Through 
programs were chosen judgmentally and selected according to criteria de- 
termined by OE. Often, individual schools were assigned Follow Through 
programs by district administrators, and teacher participation was seldom, 
if ever, determined randomly. The local projects also made purposive 
decisions about which sponsor model to adopt. As a result, the evaluation 
cannot be based on a before-after design characterized by random assign- 
ment of subjects to experimental and control groups. 

It is more appropriate to view Follow Through as a research and 
development program than as a service program, but the Follow Through 
evaluation cannot be thought of as an experiment in the strict meaning 
of that term. More accurately. Follow Through, nationally must be re- 
garded as quasi-experiments in several natural settings; data collection 
procedures can be planned and scheduled but little or no control is pos- 
sible over the specification and scheduling of experimental treatments. 

Perhaps the most critical consequence of the quasi-experimental 
character of Follow Through from a national evaluation viewpoint is that 
each individual project must be treated as essentially a separate experi- 
ment. Thus, in each of the projects that constitute the basic study 
sample, non-Follow Through comparison groups must be identified and their 
collaboration induced so that it becomes possible to contrast children 
of similar characteristics, some of whom are participants in Follow Through 
and others of whom are not. After-the-fact selection of non-Follow Through 
comparison children and families means extensive collection of descriptive 
information so that analytic adjustments can be made to help offset the 
problems of matching that are an inevitable consequence of quasi- 
experimental designs in natural settings. For example, face-to-face 
interviews were conducted with nearly 15,000 parents in 1969-70 to obtain 
information about home and family background of both Follow Through and 
non-Follow Through children, so that comparisons of changes attributable 
to Follow Through participation could be identified and better understood. 
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In interpreting the findings in this report, it is important to 
be aware of the limitations imposocJ by two characteristics of the Follow 
Through program that complicate the evaluation design: (1) the large 

number of different approach©? and (W) the manner in which participating 
schools are selected and the pairings between school districts and ex- 
perimental approaches are determined. These limitations dictate caution 
in drawing inferences about the impact of program participation. The 
SRI evaluation staff and, indeed, the OE/Follow Through staff, recognize 
and accept these limitations as part of the price that must be pyid when 
innovating programs are introduced and evaluated in the real world. 

Appendix 2 lists all projects and those selected for collection of 
data for the evaluation. For each set of data there was a somewhat dif- 
ferent set of criteria for selecting projects as sources (e.g., imple- 
mentation status of sponsor's approach, sample size and mix needed for 
analysis, budgetary limitations, sponsor representation, and willingness 
of particular communities to cooperate). 



Comparison Groups 



The essentially nonrandom character ol Follow Through as an exoerl- 
Th particularly difficult to obtain similar groups of non-Follow 

roug s udents to serve as control groups with whom to compare the ex- 
perimental classes. The term "control group," in fact, is not as appro- 
priate to^ the naturalistic setting of the Follow Through evaluation as 
e erm comparison group" which more accurately defines the situation 
to Which the evaluation must accommodate. In a social action program for 

cMld-*”f"'’^r criterion of eligibility is low Income of the 

s ami y, It IS seldom possible (and perhaps not ethically desirable) 
o employ random methods of assignment that would deny (or appear to deny) 
some eligible children access to. the program. The limited resources ol 
the Follow Through program have in practice diminished this problem of 
pupil selection, for funding clearly is not sufficient to support programs 
that could accommodate all poor children. It remains difficult, however 
to find acceptably equivalent groups of nonparticipating students In 
larger urban schools that have Follow Through programs, economic levels 
er Significantly and other classes may be Influenced by the program, 
n smaller schools and rural areas, often most or all of the eligible 

tn'* n”ii PhFticlpants, making it necessary sometimes to go outside 
the Follow Through school district to find comparison groups: In these 

se-, e ikellhood ol differences in economic level and ethnic, cul- 
rural, ana educational background increases. 
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SRI has sought comparison groups from schools contiguous to the 
Follow Through project that were similar in socioeconomic and ethnic 
status, and in Head Start experience. The evaluation has used demographic 
data collected from the schools and from parent interviews to match Follow 
Through ana comparison groups and to identify any remaining differences. 
The problems of comparability have been dealt with by analytical and sta-- 
tistical procedures, such as stratification by independent variables or 
covariate adjustments using economic-demographic factors. 



Collection of Data 



The major components in the Follow Through program are the children, 
the parents, the teachers (including aides), other school personnel, the 
community residents, local organi2at ions, and the sponsors and their 
programs. The evaluation requires information about each and about their 
interrelationships. Initial descriptive data are required to provide a 
baseline for comparisons, and oth€:r measures are needed to identify the 
program’s effects. 

The means of data collection are direct obsei’vation, surveys (inter- 
views, mailed questionnaires, and rating scales), and pupil tests. 



Instrumentation 



Eight classes of instruments have been assembled or developed to 
collect the needed data: 



1. Achievement tests for pupils 

2. Non~cognitive measures for pupils 

3. Interview forms for parents 

4. Questionnaires for teachers and aides 

5. Rating scales for sponsors to evaluate their programs 
at local sites 

6. A program implementation reviev/ 

7. Direct observation of classroom processes 

8. Case studies of selected communities. 
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At the end of the 1969-70 school year, the first five data gathering 
approaches were operational, while the latter three remained at various 
developmental stages. The evaluation findings for the years 1968-69 and 
1969-70 presented in this report, therefore, derive largely from the data 
collected by the pupil achievement test battery (including some attitude 
measures), the parent interview, the teacher/aide questionnaires, the 
sponsors' evaluations of projects, and the program implementation review. 

The instruments have developed at different rates and become opera- 
tional at different points in time,. Since academic achievement tests 
provide one obvious measure of educational program accomplishment and 
are well grounded in much previous research, the pupil achievement test 
battery could be rapidly developed and was first administered in the Fall 
of 1968. However, academic achievement measures alone are too narrow to 
embrace all objectives of Follow Through; therefore, non-academic measures 
for pupils had to be developed, starting in 1968-69. 

The program implementation review, which provides demographic 
information about the participants, and program locations and imple- 
mentation, first reached the field in June 1969. Means of measuring 
process and change among adults have been under development since the 
beginning of the evaluation but have not matured at the same rate as 
other measurement development efforts. After protracted discussion, 
trial, and revision, the parent interview was first used in January 1970. 
The teacher/aide questionnaire was first used in the Spring of 1970. 
Sponsors' assessment of teachers and sites based on rating forms was 
first used during the Slimmer of 1970. 



Pupil Achievement Test Battery . Out of discussions in mid-1968 with 
the sponsors and OE staff evolved a strategy in which a core of measures 
that met with general agreement (or lack of strong disagreement) would be 
supplemented by additional measures suggested by the individual sponsors. 
The core measures for 1968-69 were selected from nine existing tests: 

1. Lee-Clark Reading Readiness Test 

2. Metropolitan Readiness Test 

3. The Pre-School Inventory 

4. Six tests — Shape Names, Alphabet, Numerals, Prepositions, 

Pre— Mathemat ics and Pre— Science— —from New York University's 
Early Childhood Inventories Project. 
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The first three (especially the first 
The Early Childhood Inventories tests 



two) are well known standardized t 
were new and experimental in 1968. 



Items from these nine tests were included in five booklets of 
questions, four of which were designed for administration to groups of 
approximately seven students at a time and one to be administered to 

each To reduce the number of questions asked of 

student, the source tests were stratified and divided into three 

oT'tYf°t student was exposed to about one-third 

Thirt (although some items appeared in all three forms), 

-iis test battery was given to kindergartners and first graders. 



The Pall 1968 achievement test results indicated that the basic 
battery did not provide an adequate range at the top for first grade 

the deficiency. « other changes, a^xl 

for ige^vr f suggested by sponsors, resulted in a test battery 

IdLi!!!'! H°! from the tests listed below and 

e e o the grades shown (one or two rather than three forms 
were used for each grade level): 



1. Lee-Clark Reading Readiness Test 

2. NYU Early Childhood Inventories 
(Alphabet, Numerals) 

3. Pre —School Inventory 

4. Metropolitan Readiness Test (Form A) 

5. Stanford Achievement Test (Primary I, 

Form Y: Word Reading) 

6. Metropolitan Achievement Test 

(Primary II, Form A: Arithmetic 

Computation) 

7. Comprehensive Tests of Basic Skills 
(Form Q, Level l) Reading Vocabulary 
and Arithmetic Computation 

Others 

8. Wide Range Achievement Test 

9. Items from sponsors 



K, entering-1 

K, entering-1 
K, entering-1 
1 , 2 

2 

2 

3, 4 
4 

All grades 
1 , 2 , 3 



See Appendix 4 for a detailed discussion of 
test battery. 



the evolution of the 
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In addition, attitude items 
all grade levels. 



submitted by sponsors were administered 



to 



Although the batter;. Included questions dealing with pupils 

Ltt r""* study skills, most of the pupil measures obtained 

ery relate directly to performance in traditionally accepted 
academic achievement such as language and computational skill 



in this 
areas 

s . 



,, Non-cognltlve Test Battery. The non-oognltlve test battery 

eing developed to provide an adequate means for assessing the child’s 

skll rs^h ""d" traditional achievement and academic 

skills such as reading and arithmetic. The non-cognltive area is co.- 

cerned with such subjects as motivation, curiosity, creativity, self- 
confidence, and social skills. 



ann Sponsors’ 

approaches encompass more for students than academic achievement. 

suitert"f°^*™^**’'’'’ '■®®®®tched and validated procedures 

suited for ready application in the Follow trough setting. Non^cognltive 

opmeii goais of Follow Through sponsors often are stated in the form 

o pre-operatlonal verbal labels such as persistence, autonomy, and cu^ 

y ra her than in specific, measurable terms ; and non~cognitive goals 

deL ll ^ ^ -rrlculum as are traditional 

sensitltrtrihe th"”*" significant and especially 

to the ethnic minority groups which are heavily represented 

among Follow Through participants, and It Is therefore part 

essential to their advancement Ac: a rfac:ni+ o j ^ 

fort has been necessarv to acc v.i ’ developmental ef- 

s oeen necessary to assemble a non-cognitive test battery. 

The present battery was field in o • ^ 

studentci in as 1 iieid tested in the Spring of 1970 with 845 

students in 45 classrooms at 8 project sites. The specific non-cognitive 

c ives Insured by the battery derived from the goals stated by the 

Follow Through Program Guldallnes, by sponsors, and by spokesme .1 /orZ. 

ethnic minorities. The general aim of the battery is to assess thref 

fectlveness of the program in developing in pupils confident and opt! 

mistic attitudes toward themselves, toward learning, and toward par-icin 

ntion in educational institutions, and In dlminlshi;g feelings of an^et; 

impotence, and hopelessness. Eight specific areas were selerted for 
measurement: lor 
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1. Ethnic identity 

2. Attitudes toward school 

3. Task orientation 

4. Curiosity 
3. Autonomy 

6. Self-esteem 

7. School fearfulness 

8. Locus of control. 



Further details regarding the non-cogniti ve pupil test 
contained in Appendix 5. 



battery are 



Parent Int ervle'v Survey . A major survey of parents of children 
tested in Follow Through and comparison classes was undertaken betveen 
January and March of 1970. Its major purpose was to identify certain 
attitudes and actions of parents and to obtain Information about demo- 
graphic and other characteristics of the household. The survey concen- 
trated on collecting data that might be related to the develooment and 
educational progress of the child, might change over time as a conse- 
quence of participation in Follow Through, and would be helpful in es- 
timating the comparability of Follow Through and non-Pollow Through chll 

dren. Information obtained by the parent interviews falls into ten 
general categories: 



1. Interest in and knowledge about Follow Through 

2. Participation in policy making with respect to educational 
programs 

3. Parent contact with the school and its staff 

4. Feelings of efficacy in relation to the school 

5. Feelings of being able to control one 's life 

6. Support and guidance of the child with respect to educa- 
tional programs 

7. Extent of educationally relevant stimulation in the home 
environment 

8. Aspirations for the child's future 

9. General "life style" and attitudes 
Demographic descriptive information. 
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Th© data. coll©cted from par©nts provide a basis for determining 
the extent to which family characteristics and changes in them are re- 
lated to other factors such as the child’s performance in school, teacher 
attitudes and behavior, and the organization and administration of the 
school . 



All parent interviews took place in the home. Development of the 
interview form began late in 1968 and systematic field testing occurred 
during the Summer of 1969. By that time it was evident from the 1968—69 
achievement test data that much mere accurate and extensive demographic 
data than were available from the schools were needed, to estimate the 
equivalence of the comparison groups. Also, to provide comparative 
evaluations of sponsors, it was necessary to include a sample from each 
sponsor’s projects sufficient for this purpose. As a result, the number 
of parent interviews required was large. Over 15,000 potential respon- 
dents were located, and interviews with over 14,000 in 49 communities 
with a total of 65 Follow Through projects were completed and used in 
the analysis. The components of the sample were: 

Farents of entering“*grade pupils Percent 

Follow Through 41^ 

non-Follow Through 23 

Parents of pupils beyond entering grade 



Follow Through g 
non-Follow Through 2 
Parents of fourth graders 26 



Total 100^ 



The data from parents of grade four pupils are not included in current 
analyses: they were gathered for this last generation of children .vho 

could not have expe.rienced either Head Start of Follow Through to provide 
future comparisons with present Follow Through children when they reach 
the fourth grade. 



In the long term plan for the evaluation, parents v/ould not be re- 
interviewed until the Spring of the year in which their children complete 
the third grade. Shorter term effects of Follow Through participation 
are also important, however, so the overall plan also calls for inter- 
views with some parents more frequently. 



Additional information regarding the parent 
in Appendix 6. 
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survey is contained 



Teacher/^ide Questionnaires . A survey of teacher practices and 
attitudes, i-:uder development during 1968-70, was administered during the 
Spring of 1970. The teacher questionnaire (described fully in Appendix 7) 
included questions in the following areas: 

1. Demographic information and background 

2. Classroom practices 

3. Availability and use of equipment and materials 

4. Educational goals for children 

5. Information and attitudes about home visits and parent 
participation in the classroom 

6. Knowledge about Follow Through, manner of involvement with 
the program, and opinions about its effectiveness 

7. General assessment of pupil progress. 

A similar, shorter questionnaire was also given to classroom assistants 
or aides. 

Responses were received from approximately 90^ of the sample of 
Follow Through teachers and 80^ of the non-Follow Through teachers who 
received the questionnaire. These data are useful primarily for ex- 
ploring the relationships between teacher characteristics, attitudes 
and classroom practices, and pupil development. 



Sponsor Evaluation of Teachers and Sites . The sponsors themselves 
are best qualified to judge the extent to which their approaches are 
being implemented locally as intended. In July 1970, therefore, the 
sponsors were asked to assess the implementation of their programs in 
two ways. 

First, the sponsor was asked to evaluate each of his local projects 
according to his overall satisfaction with the project's development, 
either by ranking his projects from most to least successful or by placing 
each on. a scale that ranked the degree to which he felt his model had been 
implemented. Second, each sponsor was also asked to rate each of his 
teachers according to those criteria that defined acceptable teacher per- 
formance in his model. Three ratings were requested: the level of func- 

tioning achieved by the end of the 1969-70 school year, the teacher's 

growth during the same year, and expectations of further growth during 
1970-71. 



The sponsor evaluations supplemented their formal pro, • descriptions 
as a means of characterizing the various models, provided an additional 
set of measures that could be correlated with other indicators of project 
outcome, and, by identifying notable local results, suggested locations 
for more intensive investigations to seek the reasons for unusual results. 



Program Imple mentation Review . The program implementation review 
collected basic data about participants and program implementation at 
each project site. Demographic information about students and staff, 
the socioeconomic status of students and their families, numbers of class- 
rooms, schools and class size, the criteria used in the selection of stu- 
dents and staff, and data about delivery of services were collected. The 
program review survey was purposefully constructed with reference to the 
Follow Through Program Guidelines in order to compare actual with intended 
practices and therefore placed particular emphasis on, for example, the 
composition and activities of the PAG. 



The program review accumulated information from rosters of students 
and Follow Through personnel provided by the schools, and from interviews 
with the Follow Through coordinator and the PAG chairman. The 1968-69 
review included interviews with two teachers at each grade level at each 
project, and an interview with the person most knowledgeable about the 
Follow Through health program; in 1969-70, these functions were assumed 
by the teacher /aide questionnaires anr, by the Bio-Dynamics Study of health 
services, respectively. Also, as part of the 1969-70 review, both the 
Follow Through coordinator and the PAG chairman were asked to describe 
tneir goals for the Follow Through program and for PAG, and to suggest 
the kinds of evidence that would show these goals were being achieved. 



Classroom Observation. The classroom observation instrument provides 
a structured description of what takes place in the Follow Through class- 
room. Its purpose is to make a record of classroom activities, the class- 
room environment, and the interactions between the teacher and aides and 
the children, and among the children themselves. This observation in- 
strument was developed to focus in particular upon instructional methods 
interpersonal interactions, and classroom atmosphere in the ways necessary 
to describe the various sponsor models. 

The development of this procedure for describing both processes and 
outcomes through direct observation began in the Fall of 1968. By the 
end of the 1968-69 school year, a trial version was tested in* a small 
number of classrooms; it showed promise for describing the affective 
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climate of classrooms, their physical environment and arrangement, and 
the activities conducted in them, but left much to be desired in its 
capacity for describing process variables. 

The rate of development was accelerated in Fall 1969. Particularly 
useful assistance was provided by sponsors and -'inable counsel was 
received from advisers to SRI. By early April 1970 the classroom obser- 
vation procedure had been refined and pretested sufficiently to warrant 
wider application in Follow Through locations that also shared a Head 
Start planned variation experiment. 

Each classroom in the observation sample was observed for three full 
days, for two successive days by one observer and for one day by a second 
observer. Approximately every 15 minutes, the observer filled in a class 
room activities checklist, a five-minute interaction schedule, and a five 
minute summary rating. As opportunity permitted, outdoor activities were 
observed and recorded separately. At the close of the observation day, 
a summary rating of the classroom environment, the physical arrangements, 
and the equipment and materials available was made. 

classroom activities checklist yields data about what each adult 
in tn^ classroom is doing, the size of the groups of children, and the 
nature of the activities in progress. The five-minute interaction ob- 
servation has four columns for recording who does the action, to whom is 
it done, what is done, and how is it done, ’’What" is done includes such 
actions as helping, asking, teaching, observing, praising, giving cor- 
rective feedback, or rejecting. The "how” of the action includes both 
its affective quality and the method of correction or control: for 

example, happy, sad, or angry; praise, guidance, or punishment. The 
five-minute ratings incorporate the level of attention, creativity, and 
respect that adults show toward children. The outdoor observat ion ’ at- 
tends to four areas: the variety of activities, teacher directiveness, 

child independence, and the nature of the interactions between children. 
The summary of the classroom environment assesses the levels of courtesy 
friendliness, confidence, and independence, and the manner in which any 
disruptive behavior is handled. 

The classroom observation instrument, as a record of the actual 
instructional process, allows validation of the perceptions of teachers, 
parents, and school personnel as recorded through other instruments. 

It IS part of the effort to establish the connections between the methods 
by which students are taught and the changes that take place in them 
A similar observation instrument is being used in the SRI evalcat ion * of 
the Head Start experimental Planned Variation program. 
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The Follow Through classroom observation Instrument was applied in 
some 60 classrooms at S projects in the Spring „f 1970 , and has become 
part of data collection for 1970—71, 



Community Studies . The community studies seek to document the 
effects of Follow Through on institution? 1 relationships, particularly 
those involving educational institutions. They address new patter-ns of 
relationships among parents, school staff, the local community, and the 
various formal and informal community agencies that occur when Follow 
Through enters a community. Such changes are described within the eco- 
nomic and political context of the specific site. These studies also 
take into account the inputs, new roles and new institutional components 
w 1 C Oj.low Through introduces into the school and communit y--the Follow 
Through Coordinator and the Policy Advisory Committee, the sponsor and 
the Office of Education consultants, and even the presence of the evalu- 
ation. The studies also collect some historical, social, and demographic 
background information to provide a context within which to interpret 
these changes. The case study method was adopted because of the desire 

for a holistic and contextual view of such a complex phenomenon as Follow 
Through . 



During 1968-69 studies were conducted at three sites: San Diego 

California, Pulaski County, Arkansas, and Cleveland, Ohio. During 1969-70 
the first two were continued and three more added: San Jose, California ’ 
St. Martin Parish, Louisiana, and McDowell County, West Virginia. These' 
sites were selected to represent various geographic areas, types of com- 
munities, and modes of origin of Follow Through programs. These studies 
have been conducted by teams of two research associates living in or near 
the community, the senior member an experienced social scientist and the 
associate member experienced in a research-related field but having less 
ormal academic training. The teams gathered data through interviews 
record searches, library research, and observation. 



Project and Person Data Base 

Decisions about the amount of data to collect have been governed by 
a number of important considerat ioas . Foremost are the requirements im- 
posed by the need for adequate size for the statistical methods employed 
in the analyses. The data being analyzed must include a sufficient num- 
ber of projects from each sponsor upon which to base evaluation of the 
sponsor's program, and a representative variety of projects upon which 
to base evaluations at the project level. The data collected at each 
project and for each sponsor is cumulative, in that the amount of data 
available increases each year; therefore, certain analyses by project and 
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by sponsor will be possible at the end of four years which are not pos- 
sible now. The expenses of data collection are powerful reasons for 
keeping the numbers small. But the non-random nature of Follow Through 
as an experiment requires that the number of cases be large. Also, the 
attrition of subjects that inevitably occurs in a longitudinal study over 

three or four years imposes an even greater need for a large initial num- 
ber of cases. 

Approximately five or six districts or projects per sponsor have been 
deemed desirable to provide a variety of settings in which each sponsor’s 
program is implemented. A smaller number of districts per sponsor would 
be too few given the large variety of environmental conditions that inter- 
act with the sponsor programs; a larger number would be too costly. 

Among the "mature” sponsors in 1969-70, the actual number of projects 
ranged from two (maximum possible in one sponsor case) to eight (about 
half of the sponsor's toi;al) . 

Within most school districts in the data base, all entering grade 
Follow Through children were included in the Fall 1969 testing program. 

It is expected that 40% to 50% of the children will leave the Follow 
Through program over a three or four year period, primarily because their 
parents move away , In addition, h owever, not all children in the Followl 
Through program meet the OEO pov'erty delinition for eligibility and some ( 
of these children are therefore excluded from the Follow Through versus J 
non-Follow Through comparisons. As a result of such factors, data will 
be available for much fewer of these children three to four years hence. 

A roughly equal number o:i aon-Follow Through children are in the test 
group. 

Parent interviews were obtained in many projects for which pupil test 
data were obtained, and a very high proportion of parents of Follow Through 
and non-Follow Through children in those projects have been interviewed. 

All Follow Through and non-Follow Through teachers in these districts were 
sent questionnaires. 

Table 1 shows the numbers of projects and persons included in each 
of the data collection activities during 1969-70. These activities are 
shown in the approximate sequence in which they occurred, but several 
shown for the Spring of 1970 actually overlapped each other. 
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Table 1 



PROJECT AND PERSON DATA BASE FOR DATA COLLECTION ACTIVITIES, i 969-70 

Number by Grade 



Data Collection Activity Group 

Pupil Roster, Fall 1969 



Unit 



E-1 



NE-1 



Total 



All 

FT + NPT 



Classroom Testing, Fall 1969 
Initial Test Group ft 

NFT 

Completed Tests (Matched) FT 

NFT 

Parent Survey, Spring 1970 FT 



NFT 



Teacher & Aide Survey, 
Spring 1970 



Classroom Observation, 
spring 1970 



Non-cognit i ve Measurement 
Pilot Study, Spring 1970 



Classroom Testing, Spring 
1970 



* T + NFT 
FT 
FT 
NFT 



FT + NFT 
NFT 



Projects 


65 


26 


52 


42 


10 


84 


89* 


Pupils 


13,807 


6,025 


7,793 


5,110 


827 


11,612 


45,174 


Projects 


59 


24 


48 


35 


7 




86^ 


Pupils 


6,619 


3,003 


3,604 


2,430 


383 





16,039 


Projects 


59 


24 


48 


35 


7 


84 


86 


Pupils 


3,779 


1,708 


2,354 


1,561 


235 


9,649 


19,286 


Pupils 


6,249 


2,774 


c 


:i6 


239 




14,764 


Pupi Is 


3,688 


1,628 


2 » . 


.24 


134 


(N.A.) 


9,021 


Projects 


45 


19 


31 


13 






65 


Interviews 
compl eted 


4,040 


1,692 


815 


279 






6,826 


Projects 


39 


18 


14 


9 


— — 


60 


65 


Interviews 

completed 


2,120 


1,122 


206 


99 


-- 


3 , 685 


7,232 


Projects 






levels 


combined 




89 


Teachers 


283 


.132 


161 


105 


14 





695 


Aides 


2ot 


124 


154 


91 


13 




640 


Teachers 


113 


68 


6a 


53 


9 


— 


303 



^ lA^ 



Projects 

Classrooms 

Classrooms 



3 
6 

4 



5 

10 

10 



FT + NFT 
FT 

NFT 



Projects 

Classrooms 

Pupils 

Classrooms 

Pupils 



- 10 

-119 

- 9 

-103 



. 6 

- 14 — 
-317 — 

- 12 - 
-291 — 



0 

- 0 

- 0 

- 0 

u 



7 

30 

28 



8 

24 

436 

21 

394 



Initial Test Group 


FT 


Projects 

Pupils 


18 

2 ,623 


9 

1,119 


21 

1,675 


19 

1,504 


4 

294 


— 


31 

7 ,215 




NFT 


Projects 

Pupils 


18 

1,303 


9 

753 


21 

909 


19 

935 


4 

181 


6 

295 


30 

4,376 


Completed Tests (Matched) 


FT 


Put ils 


1,552 


946 


1,190 


1 , 127 


2J9 




5,054 




NFT 


Pupils 


894 


603 


667 


671 


134 


244 


3,213 


Commun.'ty Case Studies, 


Fall-Spring 1960-70 


ft + NFT 


Projects 




— all levels combined - 








Program Description, 


Spring 1970 


FT 


pro j ects 






combined- - 






159 


* The total number of projects shown are the nei 
are count- d only once in these totals. 




projects 


ccvr.r 


Ir-v. '..vre 


than 


one 


grade 



1969-70 and one that did not have a complete achievement batv.^n' n 196&-70 



es vrere not available in 



o 
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Two sets of figures for both Follow Through and non-Follow Through 
appear under the heading, "Classroom Testing, Fall 1969." The first 
pair of rows, the Initial Test Group," shows the number of pupils by- 
project and grade level who completed at least one of the tests in the 
classroom battery. A pupil may be shown in this count even though he 
did not complete all test booklets. The second set, "Completed Tests 
(Matched), denote the pupils for whom there is a full set of tests 
within any single variable (i.e., all booklets in the achievement test 
battery or all items in either the attitudes toward school scale or the 
interpersonal feelings scale). The differences between those two sets 
of numbers are accounted for primarily by an absence during one of the 
testing days resulting in some whole test booklets not being adminis- 
tered, or, less frequently, the omission of items in the tests that com- 
prised a variable score. 

A similar pair of entries appear under the main heading "Classroom 
Testing, Spring 1970." Here, however, the "initial Test Group" includes 
all pupils who completed one or more full tests in the Spring administra- 
tion whether or not they were represented in the Fall administration. 

The classification below it, "Completed Tests (Matched)," identifies the 
subset of pupils represented by full sets of tests in both the Fall and 
Spring test administration. 

Examination of the data tables in the report and the Appendix will 
never reproduce any of these numbers exactly for all of the tables in 
the body of the report entail additional cross-tabulations, thus requir- 
ing further matching between Spring and Fall test pairings and some addi- 
tional variable or combination of variables. For example, to classify 
pupils on Fall and Spring testing according to poverty levels requires 
all of the following information: (1) a full set of Fall tests, (2) a 

full set of Spring tes'v'^ir, and (3) information from the parent interview 
on family income, family size, and occupation of household head. 

A third set of entries that requires explanation is the total number 
of interviews completed in the parer t survey. The sum of Follow Through 
and novi-Follow Through totals 14,058; in fact, 14,833 interviews were 
completed. The totals shown in Table 1 exclude 775 cases that could not 
be matched with child informatic i by the xime the data tapes were frozen. 
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Field Work Organization 



To carry out a data collection effort of the magnitude required , 

SRI organized an extensive field staff. To maintain quality control in 
the test data collection, SRI hired experienced supervising testers who 
were local residents — usually college or university faculty or graduate 
students but not employees of the school district — and provided them 
with training in administering the SRI test battery. Some 65 supervisory 
testers and approximately twice as many aides participated in the admin- 
istration of the Fall 1968 test battery. By the middle of the 1968-69 
school year, it became evident that the Menlo Park SRI staff was too 
small to oversee effectively this data collection. Accordingly, six 
persons were appointed as regional representatives to assist in super- 
vising, recruiting, and training the testers. 

In anticipation of the increased testing load in the Fall of 1969, 
the number of regional representatives was increased to 36. The regional 
representatives typically hold a doctorate and a position as an associate 
professor at a local university. In addition, the testing team was ex- 
panded to include assistant testers as well, as supervising testers and 
aides. A total of 342 supervising testers were employed, and altogether 
approximately 1,100 different persons were required to administer the 
1969 Fall pupil achievement test battery. Nevertheless, in response to 
problems encou.ntered in the Fall teat administration, further changes in 
the field organization were necessary. In the Spring of 1970, five new 
persons were added to the Menlo Park staff as field supervisors. 

During the first two years of SRI ' s longitudinal evaluation, approxi- 
mately 1,500 people worked on developing, printing, shipping, collecting, 
reading, coding, processing, analyzing, and storing the data. 
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Processing and Storage of Data 



Data assembled in the evaluation have been coded and organized in 
a computerized data bank. A collection of computer programs are used 
to handle the data: the editing program checks the input data for 

validity and identifies the individual to whom the data relate; the 
up-dating program adds the new cards to the existi .g bank and at the 
same time maintains an index of information in tiu. bank; retrieval 
programs alio- users to obtain information from the bank without the 
necessity of writing special-purpose programs. 

The data bank accumulates and reliably matches information about 
several thousand pupils according to numerous variables. Card image 
tapes have been made to accumulate ail the data available for class- 
rooms within the basic sample: 

(1) A tape for all projects including Pall 1969 pupil achieve- 
ment test data and teacher/aide questionnaire data. 

(2) A i,ape for all projects ifie.vging the above with parent inter- 
view data for the sub-set of projects in which both twice- 

testing and interviews occurred. 

(3) A tape for projects including Fall and Spring test data, and 
teacher and parent interview data. 

(4) A tape for classrooms including the above and the classroom 
observation and non-cognit ive test data. 

The 1968—69 data bank contained over 65,000 card images, the 1969—70 
bank over 500,000. The two banks have been merged into a single bank, 
which will incorporate all further data. It is anticipated that the 
entire bank will soon include over a million card images. 



Analysis and Presentation of Data 

The independent, mediating, dependent, or criterion variables 
were identified in the selection and construction of the instruments. 
The analytical procedures identify, primarily by means of statistical 
methods, which variables exhibit significant changes (and which do not) 
and which other variables appear to be associated with these changes. 
The units of analysis include the child, the classroom, the individual 
project, sponsors, and the Follow Through program as a whole. 



c 



5 ^ 



Statistical Procedures 



As a result of the numbers of units, participants, and/ variables, 
the amount and variety of data and number of tabulations, computations, 
and specific analyses to be performed were very large. The statistical 
procedures employed are limited in number, hov/ever . Three main types 
of analyses and several supplementary ones have been used to identify 
changes and relationships in the 1968-69 and 1969-70 results: 

(1) Cross-tabulations of independent variables on which dependent 
variable measures are the '^•ell entries. 

(2) Multivariate analyses of va_ __L'nce and covariance. 

(3) Multivariate analyses of relationships among variables, 

Te'ihniques such as factor, cluster, and discriminant function analysis, 
and correlation and regression analysis, have been employed as necessary 
in problems of grouping variables or identifying the effects of different 
combinations of independent variables. 

Means had to be found to reduce the large number of variables to 
manageable proportions. Variables may be consolidated by both logical 
arid statistical means. Arguments for the consolidation or elimination 
of some derive from theory in education, psychology, sociology and re- 
lated fields. Preliminary analyses identified variables that appear to 
have little or no effect on the dependent variables. Composite score' 
were constructed from subjects’ responses to a number of questions. 

And "inally, similar variables were grouped into a single vai’iable ; 
for example, family income, education, and occupation were combined 
yield a single socioeconomic index for use in multivariate analyses 
of covariance. 

The statistical methods used to interpret the effects of Follow 
Through had to take into account the quasi-experimental character of 
the program. In a quasi-experiment, it is certainly more difficult to 
I'each statistical conclusions ■’n which one has confidence •'•han it is in 
an experiment with appropriate randomization. The analyses must be 
perfei'med ' as if certain underlying probabilistic hypotheses were 
valid. The probability statements that occur from time to time in this 
report were computed as if randomized allocation of children to Follow 
Through and non-Follow Through had occurred. Such probability statements 
should be interpreted as indicators only: they show the nature of the 

results but qualitatively rather than quantitatively. One alternative to 
randomization is to assume that the quasi— experiment accepts groups from a 
population whose parameters v;ere determined according to some underlying 



hypothesized probability distribution, and then to use Bayesian methods 
in the analysis; however, the effect of the assumptions regarding the 
underlying population would be just as subject to uncertainty and crit- 
icism as are the results of applying standard statistical hypothesis 
testing technique;^ to a quasi-experiment. Furthermore, even if random 
selection cf children, teachers and schools could be achieved, the 
effects of 'forced” cooperation and the fact that the study would be 
affected by events occurring during the long evaluation period suggest 
that it is not inevitable that predictions made on the basis of a 
rigorous random sampling design would be much better than those based 
on the several analytical methods used in this report. 



St at ist ical Presentation 



ihe very large number of relat ionsnips of interest and im- 
portance within the evaluation data, the problem of i to present 
these relationships in a manner that balances detail and comprehensi- 
bilxty is a formidable one. The feasible options for displaying data 
are constrained to some extent by SRI 's decision to rely heavily on 
cross-tabulation as a form of presentation that is least likely to be 
misinterpreted. 

Appendix A contains a set of basic tabulations in a form similar 
to the majority of data tables used in this report: 

(1) Two variables (usually both independent variable. ) define the 
column and row headings for the cross-tabula 

(2) Values on a third variable (one of the outcome measures or 
dependent variables, such as pupil attitude scores) constitute 
the table entries. Accompanying each entry, such as the mean 
score of a group defined by the two cross-tabulation variables, 
is a frequency figure thac shows how many cases are represented 
by the cell entry. 

The key experimental variable of participation in Follow Through is 
always a basic cross-tabulation variable, so that one inevitable contras v, 
or comparison is that between Follow Through and non-Follov/ Through. The 
other contrasts are between levels or strata on the other cross-tabulation 
variable (for example, the poverty level classification) and between 
dependent variable measures over time, such as the change from pre-test 
(Fall) to post-test (Spring). 
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A variety oi other presentation forms have been used. Two types of 
graphs show two contrasts that are fundamental to appraising Follow 
Through effects and correlates of them. One is a line graph in which 
Follow Through and non-Follow Through pupil scores on outcome measures 
are compared at the beginning (Fall) and end (Spring) of the 1969-70 
school year. The basic independent variable that adds meaning to these 
comparisons is the poverty classification of the pupils, so that the 
interactive influences of progi*am participation and poverty level can 
be seen. Line graphs are presented for each of three pupil outcome 
measures — achievement test scores, attitudes toward school and learning, 
and scores on a measure of interpersonal feelings- -for four grade level 
groupings: kindergarten, entering first grade (E-1) , non- v v.'ering first 

grade (NE-1) , and second grade. In all these graphs, data have been 
aggregated over all individual projects and sponsor programs so that the 
effects displayed are for Follow Through as a whole. 

The second type of graph is a bar graph, again contrasting Follow 
Through and non-Follow Through at two times (Fall and Spring) at each 
grade level for each of the three outcome measures mentioned above. In 
the bar graphs, however, the focus is on differences among groups of 
sponsors — that is, on treatment differences — rat hex* than on differences 
associated with an antecedent variable such as level of poverty. Thus, 
in the bar graphs, the effects of different approaches within Follow 
Through as a whole are highlighted. 

Each of the graphs is supported by a series of tables in Appendix A 
that contain much more information than can be shown conveniently in a 
graph (e.g., numbers of pupils, standard deviations of score distribu- 
tions, and t— ratios by which to judge the significance of observed 
differences) . 

In this main body of the report, summary tables are shown that have 
been derived from the more detailed tables in Appendix A. An important 
caution about tables will be repeated throughou* the discussion of the 
findings. Typically, the appendix tables show all pupils on whom various 
data were available. Within the body of the report, however, most of 
the tables show information about only the sub-set of pupils whose pov- 
®rty classification affirms t.ieir eligibility for participation in Follow 
Through — the Certain” and ’’Possible" poverty groups, as described in 
Appendix 1. In short, most of the tables in the bO'dy of the report 
exclude pupils from families that clearly do not meet the poverty cri- 
terion of the Follow Through Program Guidelines. 

A presentation combining tabulation and graphic effect has been 
adopted for reporting results of the evaluation. In these presentations. 



signs (+ or -) have been substituted for numbers to reduce the "noise” 
and thereby highlight essential relationships. Again, detailed tables 
gxven in appendices support these summary presentations. 

The use of the sign (+ or -) tables raises the question of which 
IS the best or most appropriate index of effect. Is the best index the 
Spring (post-test) measure of the outcome variable or is it the dif- 
ference between the Fall and Spring measures (post-test minus pre-test)? 
Since each gives different information and neither seems universally 
best for all contrasts of interest, both are presented. 

Two simple conventions have been used in the sign (+ or -) tables: 

(1) Signs appear -n sets of three (i.e., +++, so on). 

The first or ^^it-hand sign denotes the direction of difference 
betwe6»n Follow Through and non-Follow Through at the Fall or 
pre-test point. The middle sign denotes the Spring or post- 
test difference, and the third or right-hand sign denotes the 
difference between Spring and Fall ([post] - [pre ]) . 

(2) Plus (+) Signs mean that Follow Through has a higher score 
value than non-Follow Thi. ogh and minus (-) signs mean that 
Follow Through has a lower score value than non-Follow Through. 
Occasionally , when the number of cases compared was very small 
the observed difference between Fellow Through and non-Follow 
Through groups was zero. These rare occurrences have been 
shown as plus (+) . Thus, for the first and second signs, the 
sign denotes the direction of the (FT)-(NFT) difference on 
either the Fall (pre-test) or opring (post— test) measures. 

The third sign denotes a difference between differences ; that 
IS, plus (+) means FT(post-pre) ^ ^^(post-pre) minus 

means FT(p„ 3 t-pre) ^ 

Six combinations of signs are empirically possible: -++ 

I-, ++-, + , and . The combinations of +-+ and -+- are 

not possible according to the foregoing definitions. For ex- 
ample, +-+ would mean FT > NFT on pre-test, FT < NFT on post- 

s , but that pos t-prci ) " pos t-pre) * Neither this nor 

the reverse, of course, is empirically possible. For those 
V. .niuk graphically, three basic patterns are represented: 

The +++ and patterns show divergence. 

The — (-+ and + — patterns show a cross-over 

The 1 - and H patterns show convergence. 

The two converging patterns illustrate the dilemm’a of judging 
which outcome is of most worth: a higher level or greater gain. 
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IV SPONSORS AND S>ROJECTS 



Grouping of Sponsors 

The differential assessment of part icular sponsor models has not 
yet been undertaken. Such comparisons at this time would be premature 
and inappropx'iate , for two important reasons: 

(1) Projects differ in their state of implementation, and contrast— 
ing a well established approach with one in which some implemen- 
tation difficulties are still being encountered would not pro- 
vide a fair test of the relative efficacy of the approaches. 

(2) The sponsors differ markedly among themselves in the particular 
objectives that are salient for them at different grade levels. 
(This assertion must be taken partly on faith, for the sponsors 
also differ among themselves in their ability or willingness 

to express some of their objectives in terms that suggest appro- 
priate modes of measurement.) 

The question of which general approaches appear to be achieving most 
fully their intended purposes remains a question of wide interest; over 
the long term, this will be an increasingly central issue in the longi- 
tudinal assessment but in the present report, sponsor approaches or models 
have been grouped into five gross categories for some preliminary compari- 
sons. These groupings, admittedly, are judgmental ones based on affinities 
among sponsors in the philosophical and theoretical underpinnings of their 
approaches and similarities in their processes and procedures. Over the 
long term, these classifications will be refined and undoubtedly revised. 
Some of the data contained in this report — for example, some of the teacher 
beliefs and practices — suggest bases for more sophisticated groupings ac- 
cording to instructional process variables. 

A brief statement of some of the salient characteristics of the spon- 
sor in each group is give^l below.* 



* Brief descriptions of sponsor’s approaches have been compiled in the 
following document available from the Follow Through Program Office, 
Office of Education: ’^Program Approaches, Follow Through, School Year 

1970-71.” 
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Sponsor Group 1 



These sponsors emphasize curriculum and teaching methods within the 
classroom. Most are behaviorists v;ho make extensive use of programmed 
learning, teaching devices, structured curriculum broken into small units 
of learning, and systematic reinforcement and reward. This group includes 
the following models: 

(1) Approaches based on IPI and primary education project — 

Lauren Resnick and Warren Shepler, 

University of Pittsburgh 

(2) Behavioi" analysis approach — 

Donald Bushell, Jr., 

University of Kansas 

(3) Mathemagenic activities program — • 

Charles Smock, 

University of Georgia 

(4) Language development-bilingual education approach — 

Juan Lujan, 

Southwest Educational Development Laboratory 

(5) Responsive Environments Corporation model — 

Rut he Farmer, 

Responsive Environments Corporation 

(6) Systematic use of behavioral principles program — 

Siegfried Engelmann and Wesley Becker, 

University of Oregon. 



Sponsor Group 2 



Group 2 shares a strong commitment to humanistic values with special 
emphasis on development in non-cognitive areas (e.g’., sense of self-worth, 
respect for others, curiosity and willingness to explore). They advocate 
the inquiry or discovery model of learning. The approaches iiiCluded in 
this group are: 

(1) Bank College of Education approach — 

Elizabeth:- Gil ke son. 

Bank Street College of Education 




(2) Education Development Center approach — 

Frank Watson, 

Education Development Center 

(3) Responsive environment approach — 

Glen Nimnicht, 

Far West Laboratory for Educational Research and Development 



Sponsor Group 3 



Here are included approaches that are less systematically similar 
to one another than those in either of the previous groupings. Generally, 
they share a willingness to be eclectic, drawing from a variety of philo- 
sophical and theoretical positions and selecting techniques on pragmatic 
grounds. Such a characterization does obvious disservice to some of the 
approaches included in this group, for it implies less internal consis- 
tencj^ within the approach than actually obtains. Sponsors included in 
Group 3 are: 

(1) Behavior-oriented prescriptive teaching approach-— 

Walter Hodges, 

State College of Arkansas 

(2) California process model — 

Ruth Love Holloway, 

California State Department of Education 

(3) Cognitively oriented curriculum model — 

David Weikart, 

High/Scope Educational Research Foundation 

(4) Cultural linguistic approach — 

Nancy Arnez, 

Northeastern Illinois State College 

(5) Florida parent education model — 

Ira Gordon, 

University of Florida 

(6) Hampton Institute nongraded model — 

Mary Christian, 

Hampton Institute 




(7) Home-school partnership— 

Edward Johnson, 

Southern University and A & M College 

(8) Interdependent learner model — 

Lassar Gotkin, 

New York University 

(9) Tucson early education model — 

Joseph Fillerup 

University of Arizona 



Sponsor Groups 4 and 5 

Sponsor Groups 4 and 5 have been kept separate from one another and 
from the others because of unique characteristics of sponsorship rather 
than because of similarities among them in the processes that they employ. 
Group 4 includes all the projects that are self-sponsored — i.e., ones in 
which local school district staff have played the role of architects and 
implementers of the Follow Through model. All projects in Group 4 are 
from the initial group of districts that joined the Follow Through experi- 
ment in 1967-68. Included are: 

Dade County, Fla. 

Detroit, Mich. 

Hawaii 

Monongalia County, W. Va. 

PS-33, New York City, N.Y. 

Philadelphia VII, Pa. 

Portland, Ore. 

San Diego, Calif. 

Sponsor Group 5 includes the parent-implemented projects that do not 
have a secondary affiliation with an instructional model. The most prom- 
inent attribute of the parent-implemented projects is their political, 
more than their educational, orientation. The parent-implemented proj- 
ects may differ considerably from one another in the approach and style 
of their instructional program but all share a commitment to high levels 
of parent participation in policy making and program planning. Projects 
included in Sponsor Group 5 are; 

Roxbury Community School, Dorchester, Mass, 

Philadelphia III, Pa. 

Pulaski County, Ark, 

East Harlem Block Schools, New York City, N.Y, 

Highland Park Free School, Boston, Mass, 

O 

ERIC 




Program Implementation as Judged by Sponsors 



As already implied, a concern throughout the evaluation has been to 
assure that contrasts between and among program approaches was fair to 
each approach in the light of its implementation status. Continuously 
since 1968 information has been gathered through conversations with spon- 
SGIS, formal inquiries to them, and occasional site visits regarding 
implementation. The findings presented in this section relate various 
measures of program performance to the ratings and rankings of projects 
provided by several of the Follow Through sponsors themselves, on the 
assumption that project implementation is best assessed by the program 
sponsor since he best knows the extent to which any of his projects are 
approaching the ideal of his model. Thus, the criterion of implementa- 
tion status of a project is the sponsor's judgment. 



Each of 12 sponsors was asked to provide two kinds 
his projects. First was a rating on a ten-point scale i 
velopmental state of each of several specified projects 
terion of the sponsor's opinion of "ideal," wei hing all 
collectively made up the sponsor's notion of the ideal, 
for the judgment was the end of the school year 1969—70. 



of judgments about 
ndicating the de- 
against the cri- 
the factors that 
The time frame 



The second measure requested from the sponsors was an ordinal ranking 
of each of the same projects, where rank "l" denoted the most fully or 
best implemented project, and rank "n" denot d the least well implemented 
one from the sponsor's perspective. 



Eight of the twelve sponsors asked pro' jd the sets of judgements 
described above, most of the others indicat g that the task seemed in- 
appropriate within their value orientation. The eight sponsors repre- 
sented 32 projects, 17 of which were in the .969-70 study sample (both 
in the Fall of 1969 and the Spring of 1970). It was possible, there- 
fore, to examine correlates of sponsor ratings and rankings m 17 proj- 
ects, 12 of these 17 included children who were in their first year and 
second year of Follow Through and the remaining five projects included 
children in their first, second, and third year. 



Project Ratings and Rankings 

The ratings of 17 projects on the scale from 1 ("as far from the 

Ideal as I can Imagine ) to 10 ("as close to the Ideal as I can Imagine") 

ranged from a low of 3 to a high of 8. The modal rating was 7, the median 

rating was 6.5, and the mean rating was 6.15. The standard deviation of 
the ratings was 1,27, 
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Most replies from sponsors included qualifying comments. Typically, 
these underscored sources of variation within projects such as degree of 
administrative enthusiasm and support for Follow Through by local staff, 
and teacher turnover. 

There was a slight tendency for projects that included pupils with 
three years experience in Follow Through to be rated more highly than 
those that included only two years of experience. This difference, how- 
ever, was trivial. Three of the five projects with pupils who had three 
experience years were rated at 7 and two were rated at 6 or below; five 
of the twelve projects with two years’ experience were rated at 7 or 
higher and the remaining seven were rated at 6 or below. 

Examination of the ratings and accompanying comments showed clearly 
that sponsors applied somewhat different standards of rigor and aspira- 
tions in their judgments of the extent to which each project had ap- 
roached an "ideal" state. Nevertheless, the correlation between ratings 
and rankings was .84 for the 17 projects. 

Examination of the ordinal rankings of the status of project imple- 
mentation showed that 13 of the 17 projects in the 1969-70 study sample 
were ranked at or above the midpoint in each sponsor's set. The 17 pro- 
jects that provide the basis for the data reported below, therefore, can 
be taken to represent the majority of the projects (from this set of 32) 
that sponsors considered to be reasonably well implemented. 



Analyses 



Sponsors' ratings of 17 projects on the ten— point scale and their 
rankings of these same projects correlated reasonably closely (.84). 
Furthermore, the sponsor rankings of project implementation appeared 
to be more reliable indices of implementation than the ratings since 
the rankings required paired comparisons among all projects and thereby 
eliminated some of the variability in ratings of a project against an 
unspecified "ideal" that obviously has somewhat different meanings for 
each sponsor. For these reasons, analyses of correlates of a project's 
state of implementation used the transformed ranking, rather than the 
rating, as the index of implementation. Tables 2 , 3 , and 4 show the 

characteristics of high- ranked and low-ranked projects on three measures 
of difference between Follow Through and non-Follow Through. The dif- 
ference scores are as defined earlier; FT. minus NFT 

(post-pre) (post-pre)* 



* Rankings were transformed to T— scores to take account of the total of 
32 projects that were considered when the 17 projects were ranked. 
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Table 2 



SPONSOR RANKINGS OF STATUS OF PROJECT IMPLEMENTATION RELATED TO 

(ft)-(nft) differences in achievement test scores 

(8 Sponsors with 17 Projects) 



Ranking 


Statistic 


Chi Id * s Year i .\ 
Follow Through 
Entering Second Third 

Year Year Year 


Total 


At or above the 
mid-point of 


Mean difference 
score* 


2.15 


0.41 


1.42 


1.30 


sponsors’ projects 


N umbe r of group s 


13 


13 


4 


30 




S.D- of 

difference 

scores 


3.36 


2.61 


1.52 


2.97 


Below the mid- 
point of sponsors • 


Mean difference 
score 


- 1.59 


- 1.97 


2.91 


- 1.26 


projects 


Number of groups 


4 


4 


1 


9 




S.D. of 

difference 

scores 


0.86 


2.34 




2.23 


Total, 17 projects 


Mean difference 
score 


1.27 


- 0.15 


1.72 


0.71 




Number of groups 


17 


17 


5 


39 




S.D. of 
di f f erence 
scores 


3.36 


2.74 


1.48 


3.01 


Difference 


Mean difference 


3.75 


2.38 


1.49 


2.56 


between high- 
ranked and low- 
ranked projects 


S.D. of mean 
difference 


1.03 


1.38 




0.92 




t -ratio 


3.65 


1.73 


— 


2.78 




Probability 


< .005 


^ .10 




< .01 



Difference 




post-pre) 



- NFT, 

(post~pre). 
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Table 3 



SPONSOR RANKINGS OF STATUS OF PROJECT IMPLEMENTATION RELATED TO 
(FT)-(NFT) DIFFERENCES IN PUPILS* ATTITUDES TOWARD SCHOOL 
(8 Sponsors with 17 Projects) 



Ranking 



At or above the 
mid-point of 
sponsors * projects 



Below the mid- 
point of sponsors * 
projects 



Total, 17 projects 



Difference 
between high- 
ranked and low- 
ranked projects 



Statistic 



Mean difference 
score* 

Number of groups 

S*D. of 
di f f erence 
scores 

Mean difference 
score 

Number of groups 

S.D. of 

difference 

scores 

Mean difference 
score 

Number of groups 

S.D. of 

difference 

scores 

Mean difference 

S.D. of mean 
difference 

t-ra tio 

Probability 



Child's Year in 
Follow Through 




Entering 

Year 


Second 

Year 


Third 

Year 


Total 


- 0.97 


- 0.88 


-3.40 


- 1.26 


13 


13 


4 


30 


2.47 


3.74 


2.33 


3.18 


0.62 


-0.19 


- 0.75 


0.11 


4 


4 


1 


9 


1.39 


3.50 


— 


2.56 


- 0.60 


- 0.72 


- 2.87 


- 0.94 


17 


17 


5 


39 


2.37 


3. 69 


2.34 


3.11 


- 1.60 


-0.68 


- 2.66 


- 1.36 


0.98 


2.03 


— 


1.03 


- 1.63 


- 0.34 


— 


- 1.32 


> .10 


> .50 


— — 


.20 



Note: Lower score on attitude measure denotes more positive attitude toward 

school and learning; negative difference desirable from Follow Through 
perspective. 

* Difference = FT* . - NET 

(post-pre) (post-pre) . 
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Table 4 



SPONSOR RANKINGS OF STATUS OF PROJECT IMPLEMENTATION RELATED TO 
(FT)<-(NFT) DIFFERENCES IN PUPILS’ INTERPERSONAL FEELINGS 
(8 Sponsors with 17 Projects) 



Child ’ s Year in 
Follow Through 



Ranking 


Statistic 


Entering 

Year 


Second 
Yea r 


Third 

Year 


Total 


At or above the 
mid-point of 


Mean difference 
score* 


0.05 


- 0.71 


- 1.03 


- 0.42 


sponsors' projects 


Number of groups 


13 


13 


4 


30 


• 


S . D . of 

difference 

scores 


2.94 


2.93 


5.02 


3.32 


Below the mid- 
point of sponsors ’ 


Mean difference 
sco7'e 


1.85 


2,32 


3.35 


2.23 


projects 


Nvmber of groups 


4 


4 


1 


9 




S»D. of L 
difference 
scores 


3.13 


3.80 




3.32 


Total, 17 projects 


Mean difference 
score 


0. 48 


0.003 


- 0.15 


0.19 




Number of groups 


17 


17 


5 


39 




S.D. of 

difference 

scores 


3.08 


3,41 


4.82 


3.50 


Difference 


Mean difference 


- 1.80 


- 3.04 


- 0.88 


- 2.65 


between high- 
ranked and low- 
ranked projects 


S.D. of mean 
difference 


1.76 


2.07 


-MM 


1.26 




t-ra tio 


- 1.02 


- 1.47 


— 


- 2.10 




Probability 


> .20 


> .10 


MM 


< .05 



Note : 



Lower score on attitude measure denotes more positive interpersonal 
feelings j negative difference desirable from Follow Through perspective • 



= FT 



- NFT. 



(post-pre) . 
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Difference 



(post-p re) 



In reading Tables 3 and 4 , it is important to remember that a 

score on both of these two attitude scales represents a more posi- 
tive attitude. Thus, a negative difference score in these tables re- 
flects a difference favoring Follow Through. In Table 2, however, a 
more conventional metric was followed and a positive difference favors 
Follow Through. 

Table 2 indicates that projects ranked in the top half of a spon- 
sor's set show statistically significant higher pupil achievement than 
do projects ranked in the bottom half. Taking all three child experience 
levels in Follow Through together, this difference was significant at 
less than the .01 level and was significant at less than the .005 level 
for the first experience year. 

Differences between high-ranked and low-ranked projects on measures 
of pupil attitude toward school (Table 3 ) were not statistically reliable 
but were in the direction favoring Follov?* Through. The magnitude of the 
difference overall yielded a significance level of about .20; that is, 
there xs about one chance in five that the difference is random. Rela- 
tively, the greatest difference between Follow Through and non-Follow 
Through occurred in the first experience year where the statistical 
significance of the difference was between ,20 and .10. 

The scores on the scale of pupil interpersonal feelings showed a 
stronger relationship to project rankings than did the measure of atti- 
tude toward school. As Table 4 . indicates, the overall difference favored 
Follow Through and was statistically significant at less than the .05 
level. In contrast to the attitude trends shown in Table 3, however, 
the relative differences favored children at higher rather than lower’ 
Follow Through experience levels, thus suggesting increasingly good in- 
terpersonal relationships (pupil-to-pupil and pupil-to-teacher) as 
children grow older and experience the program longer. 

Data from classroom observations provide additional insight into 
the status of project implementation and are reported in the next section. 
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Parent Characteristics as Indicators of Implementation Status 



Four measures of parent behavior and opinion were examined for their 
relationships to the rankings of pi’oject implementation provided by the 
sponsors. All four measures were derived from responses in the parent 
survey. 

The first variable was the parent's agreement or disagreement with 
the statement that "in this community the parents have a say about how 
the schools are run." This item was selected as a proxy for a large 
number of items dealing with the parent's sense of control and influence 
over schools. Follow Through and non-Follow Through parents were com” 
pared on this question, first, for those projects ranked by sponsors 
as most well implemented and, second, for projects ranked by sponsors 
as least well implemented. Neither comparison showed a statistically 
significant difference (p > .10 in both cases). In both comparisons, 
there was a slight tendency for more Follow Through than non-Follow 
Through parents to agree with the statement but, as the chi square 
analysis indicated, these differences were very small. 

When Follow Through parents only from both the high ranked and low 
ranked projects were compared , the diffei’ences were minor. Follow 
Through parents from both subgroups of projects showed virtually iden- 
tical proportions of parents who disagreed with the statement, more 
parents in the low ranked projects slightly agreed with the statement, 
and somewhat more parents from the high ranked projects strongly agreed 
with the statement. When the two overall distributions were compared, 
however, the amount of the difference was too small to support a con- 
clusion that a reliable difference existed. 

On this measure, indicating a sense of parental control over schools, 
therefore, there were no significant differences between projects ranked 
higher and those ranked lower by the sponsors. 

A second variable was the parent's satisfaction with the sample 
child's progress in school. Comparisons between Follow Through and 
non-Follow Through parents within both project groupings and between 
Follow Through parents in both project groupings did not show any 
significant differences. Thus, whether the project was ranked by the 
sponsor among the highest or the lowest of his projects parents expressed 
generally high satisfaction with their child's progress in school. In 
all instances, at least three-fourths of the parents indicated that they 
were "very satisfied" with their child's progress. 



A third variable was somewhat more behavioral in character (albeit, 
a self-report of behavior) and reflected the number and recency of talks 
with the child's teacher. When Follow Through and non-Follow Through 
parents were compared among projects ranked low in the implementation 
scale, there was no significant difference between them but when 
compared in projects that were ranked high on the implementation scale, 
the difference by chi square was statistically significant (p < .02). 
Surprisingly, however, the data showed that more non-Follow Through 
than Follow Through parents had talked privately with their child's 
teacher, although the data also showed that among Follow Through parents 
those contacts that had occurred were more recent than among non-Follow 
Through parents. Within high ranked projects, the same results obtained — 
there was a statistically significant difference between Follow Through 
and non-Follow Through parents (p < .02) and again, more non-Follow 
Through than Follow Through parents had talked with their child's 
teacher. 

The final variable on which Follow Through parents were compared 
was their awareness of the PAC. Substantially more Follow Through 
parents in projects ranked low in implementation than in those projects 
ranked high on implementation reported awareness of the PAC. This 
difference was statistically significant (p < .OOS). 

' \ 

The net result of these parent data analyses in relation to sponsor 
rankings of r plementation is either (l) that there are no 

reliable c tween the parent measures and the sponsor rankings, 

or ( 2 ) th£ xcally significant relatJ 'Mships run counter to expecta- 

tion. The fact that parents in projects that have been ranked high in 
implementation by sponsors are somewhat less likely than parents in low 
ranked projects to have had recent talks with teachers or to be aware 
of the PAC seems counter to the idealized expectation of Follow Through 
stimulating greater parent involvement. 



The overall patterns reported above obscure some variation from 
sponsor to sponsor in parent responses. The small number of different 
sponsors represented (eight) and the small number, of projects available 
for analysis (l7) caution against overinterpreting inter-sponsor 
differences. Even so, it is unsettling to note that it is in those 
projects which sponsors consider least well implemented that parent/ 
teacher talks and parent awareness of the PAC seem greatest. 



The most important implication for the longitudinal evaluation is 



the way these findings underscore the need for a better understanding 
of the par en^ behavior and belief cues that sponsors look for in 
assessing their priijects and the manner in which they weight these cues. 
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The present data, extended to variables in addition to those considered 
above, may suggest elaborated listings of cues and their v/eights but 
the simplistic analysis described above is not sufficient to reveal it. 
Other approaches not yet undertaken, such as a discriminant function 
analysis, might be appropriate in future assessments. More importantly, 
however, the ambiguity of the findings calls clearly for more detailed 
data and analyses. For example, it is conceivable that in "well 
implemented programs, parents are more satisfied in ways that cause 
them to talk to teachers less and be less involved in the PAG. In 
addition, a better understanding is needed of how sponsors judge the 
adequacy with which their approach is being implemented with respect to 
the parents . 
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V TEACHERS AND CLASSROOMS 



The performance of pupils as measured by academic achievement is 
very much affected by both their teachers and classrooms. The teacher 
as a source of knowledge, a guide, and an instructor is the key indivi- 
dual affecting the child's academic achievement. Teachers vary in their 
assumptions and beliefs about the natures of pupils, the learning 
process, and teaching functions, and in their practices in the class- 
room. Classrooms are also different in terms of the physical environment 
and the type and quality of resources and materials available. 

Measures of the essential characteristics of teachers, classrooms, 
and the teaching process are important to the evaluation. Two sources 
of data are used for this purpose-classroom process observation and a 
questionnaire for teachers and classroom aides. The class- 
room process observation is a relatively expensive data collection 
procedure and cannot be utilized in all locations. In 1969-70 the 
procedure was being developed and was used in only eight locations. 
Approximately 1,000 teacher questionnaires were returned to SRI. This 
section reports the findings of these two data collection sources. 

Classroom Process Observations 

Two purposes provided the rationale for the development of the 
structured classroom observation procedures briefly described in Sec- 
tion III. One was to provide a means for assessing the degree to which 
instructional approaches or models were implemented and, as a corollary 
to this, to provide a desci'iption of the model in process terms. The 
second purpose v/as to obtain information about instructional outcomes 
(primarily child behavior) that are most directly measured through 
observation. 

Involvement by the sponsors and their Joint Fellow representatives 
was a key feature of this development effort to assure that the observa- 
tion procedures would produce descriptions that satisfied criteria of 
program or model implementation. The procedures used to collect observa- 
tion data during 1969-70 met the Judgmental standard of program validity 
for eight sponsor approaches, two ;of which fall in Sponsor Group 1, three 
in Sponsor Group 2, and three in Sponsor Group 3. 




Approaches in Sponsor Group 1, as described earlier, are the most 
highly structured approaches, make systematic use of stimulus-response 
and reinforcement learning paradigms, rely heavily on behavior analysis, 
and concentrate oxi academic and pre-academic skills. Sponsor Group 2 
approaches follow a learning model based on inquiry and discovery and 
seek to impart how-to-learn techniques rather more than substance, 
particularly in the earliest school years. Sponsors in this group 
emphasize humanistic values such as strong, positive feelings of self- 
worth and respect and trust for others. The stimulation of curiosity 
and the encouragement of discovery is particularly prominent in approaches 
in this group. 

Sponsor Group 3 is more heterogeneous in approaches than the 
preceding two. As a whole, the approaches classified in Sponsor Group 3 
tend to be less systematic and more pragmatic, weaving elements from a 
variety of educational theory into coherent models. To characterize 
the approaches in Sponsor Group 3 as "unsystematic’’ does some disservice 
to them individually but the models included in this grouping occupy an 
intermediate position between the mo;re clearly opposing approaches of 
Groups 1 and 2. 

The eight approaches for which the observation procedure was 
explicitly designed for its first use were those approaches that also 
are participating in a companion study of planned variation in Head 
Start. For this reason, the developwePjt of the procedure was integrated 
between the two projects. 

Observers were recruited and trained in late March and early April 
1970, and conducted observations over the next few weeks in seven proj- 
ects in 30 Follow Through classrooms and 28 non-PuHow Through class- 
rooms. Of the 30 Follow Through classrooms, six were kindergarten, 
eight were entering first, six were non-entering first, and ten were 
second grade. The same numbers held for non-Follow Through except that 
there were four rather than six non-entering first grade classes. Each 
of the seven projects was under a different sponsor. Two projects were 
in Sponsor Group 1, two in Sponsor Group 2, and three in Sponsor Group 3. 



* Observation data from an eighth location were damaged beyond salvage 
in transit. 



The classroom observations yield several measures of implementation. 
Broadly these are (l) allocation of time to activities (academic work, 
Pl^y » arts and crafts, etc. ), (2) organization of classroom learning 
groups (large groups, small groups, individual children working inc'.e- 
pendently), (3) amount and kind of communication in the classroom, such 
as proportion of observed time used in teacher talk or child talk, the 
nature of requests and kinds of responses called for, and teacher 
responses following child questions, and (4) the focus of adult com- 
munication (e.g. , to a single child, to a small group, or to a large 
group). The findings summarized below are classified according to 
these categories of measurement. 

Before observations were begun, each of the sponsors whose class- 
rooms were to be observed was asked to specify his expectations in 
each of the four areas described above. A summary of expectations 
appears in Table 5 . 



Time Allocation to Activities 

The total number of recorded activities on the classroom checklist 
was distributed among 13 kinds of activities: 

(1) Group time, sharing, rest 

(2) Story, singing, and dancing 

(3) Numbers, mathematics 

(4) Alphabet, reading, language development 

(5) Finding out about people and how they live (social studies) 
(e) Finding out about natural world (science) 

(7) Table games, guessing game, working puzzles 
(s) Arts, crafts 

(9) Cooking, sewing, pounding or sawing 

(10) Blocks, trucks 

(11) Dolls, dress-up, water play, dramatic play 

(12) Big wheeled toys and slides 

(13) Active games with rules. 



Table 5 



SPONSOR EXPECTATIONS OF CLASSROOM OBSERVATION PROCESS VARIABLES 



Group 1 Grottp 2 Group 3 

Spon— Spon— Spon— Spon— Spon— Spon— Spon— 

sor J sor G sor N sor C sor P sor E sor I 

Grouping of adults and children 



Individual children without 
adult 

Adult and individual children 
Adult and small groups X 

Small groups without adult 



Communication: adult 

Direct request by adults X 

Adult instructs, informs 
individual child 
Adult praise of children 
or groups X 

Acknowledge adult, children 
Control by praise X 

Corrective question X 

Corrective feedback X 

Adult initiated interaction X 

Choice request by adult 
Adult interaction with 
individual child X 

Adult interaction with 
small group X 

Adult interaction with 
large group 



X 

X 

X X 

X 



X X 

X X 

X 

X XXX 

X 
X 
X 
X 

X X X X X 

XXX XX 

X a X X 




Communication: child 

Child talk 

Child interaction with 
material 

Child responses X 

Child initiated interaction 



XXX X 

XXX X 

X 

X X X X 
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When recorded activities were summarized and analyzed, the following 
findings emerged: 



(1) As the orientation of the approaches that make up the 
sponsor groups would lead one to anticipate, a greater 
number of the observed activities in Sponsor Group 1 
focused upon academic learning, such as mathematics and 
reading or language development. Models of Sponsor 
Group 1 showed the highest recorded average of academic 
activities (p < .Ol). 

( 2 ) The content and process orientations of Sponsor Group 2 
and, to a lesser extent. Sponsor Group 3 emphasize inquiry 
and exploration. Consistent with this, the observations 
showed a somewhat higher average in both these groups of 
science and social study accivities. Both Sponsor Groups 2 
and 3 were significantly higher than Group 1 in science 
activity (p < .05) but only one sponsor in Group 3 was 
markedly higher than all other sponsors in social studies. 

( 3 ) Sponsor Groups 2 and 3 used more table games to help 
children learn concepts of color, size, shape, similarities, 
and differences than did Sponsor Group T (p < .05). This 
finding xs consistent with the intent of approaches in these 
groups to maintain an environment that stimulates curiosity 
and encourages exploration. 

( 4 ) Sponsc Grc . 1 ^.,^ j i j employed arts and crafts activities 
to a greater extent than Sponsor Group 1 (p < .05). This, 
too, is in keeping with their more active character iiii 
instructional approaches. 



Organization of Classroom Learning Gi'oups 



Tour iJatterns of grouping consistent with the instruction^ 
strat:^ies of the models were derived from the classroom checkings,. 

These were (l) individual child without adult, ( 2 .) adult with individual 
childrsn, ( 3 ) adult with small groups of children, and (4) smalTL groups 
of (Children without admit. 
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TabX© 5 smninapizsdl th© sponsops r^no nru 

were contrasted to expectations, both for Individual ” 

sponsors grouped into the three main classef ttf^ =P°"-rs and 
obtain©d: ^ findings b©low w©r© 

flTT in sponsor Group 1 displayed 

of aful^ Tr'’^ n^PnntSd grouping organisation 

OX adult with small groups. 

Sponsors in Group 2 expected high conformance with three 

sLcI n groupings in their classrooms. 

Since nine classrooms were observed, 27 expectations 

were established as a target. In IS of thLe 27 contrasts 

In th expected groupings was observed. 

In the remaining 11 . a medium frequency was noted. 

in aggregate, the three sponsors in Group 3 defined seven 
grouping^pectation patterns in a total of 12 classroZs. 
in all, this produced a set of 28 target expectations 

18 L tr“v8 ® PPnervations, 

f the 28 expectations were fulfilled; i.e a hich 

ITlZTs "P® Observed, ’in seven 
Of the P8 r iPPi-innce was recorded, and in three 
8 a low incidence was recorded. 

In summary: the observations showed a high to moderately hivh 

irs3°r^r‘' ®*P®nP®>i grouping patterns and observed ones. 

numbL of^exneoLt- n==P®ntntions were fulfilled but a smaller 

nlrly 6«"f th! ex IT " «P°"n°P =P°nP 2- 

were nearly satisfied^'’ intended and the remainder 

expectati^s Cere fulfil ^dlrth" ZT n' ""T ““ 

25% were met moderately Cell "" additional 



(3) 



C p m muni cation Patterns; A mount. Kind, and Focus 

foci -d 

Observations " classroom were reflected in the process 

to one child than^of "adults talp" " higher proportion of adults talking 
finding held CCC"al1 cICssCoS ^p^^^oCrCCd"""'’" 

sponsors, desire to have adults give indCv“d"uaC \«e"«Lh"L1h" Cr" 
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rathei than to have communication directed toward a group. In Sponsor 
Group 3 most of the communication was split about equally between that 
dxrected tov/ard an individual child and that addressed to small groups. 

Classrooms in Sponsor Group 1 generally showed a high incidence 
of teacher communication to small groups of children; one of the two 
sponsors in this group, however, was somewhat more likely than the 
other to encourage teachers to direct more talk within the small groups 
to individual children. 

It may be noted in passing that when Follow Through and non-Follow 
Ihrough classrooms were contrasted overall, it was found that a signif- 
icantly greater proportion of adult talk was addressed to large groups 
in non-Follow Through classrooms (p < .05). 

Two types of adult requests were recorded: (l) a direct request 
to which there is only one known and acceptable response and ( 2 ) a 
choice request which allows the child to decide how he, will respond. 
Significantly greater proportions of direct requests wCre observed in 
Sponsor Group 1 than in Groups 2 and 3 (p < .05 and p < .01, respectively). 
Conversely, teachers in Sponsor Groups 2 and 3 addressed a higher propor- 

txon of choice requests to children than were observed in Sponsor Group 1 
(p < .05 and p < . 01 ). 

Feedback patterns varied among the models. Teachers in Sponsor 
Group 1 gave more positive praise feedback than teachers in the other 
two sponsor groups (p < . 05 ). Sponsor Group 1 teachers also made 
greater use of corrective feedback (praising desired behavior and 
ignoring unacceptable behavior) than did teachers in Sponsor Groups 2 
and 3 (p < .05). Corrective questioning was also more common in Sponsor 
Group 1, such as correcting a child by saying "Are you certain that six 
sticks from ten sticks will leave three sticks?" 

The classrooms in the three sponsor groups did not differ signif- 
icantly in the amount of child responses to adults or child initiations 
of interaction. However, when all "child talk" was considered, one 
sponsor in Group 2 showed a greater proportion of child talk than the 
other sponsors (p < .05). Under this sponsor’s approach, children are 
encouraged to talk with one another and to inform the teacher of dis- 
coveries or request information from her. In keeping with this design, 
the same sponsor in Group 2 also had a greater proportion than, other 
sponsors of children interacting with materials (p < .05). 



Taken overall, these data from the classroom observations suggest 
a high level of implementation, albeit these classes were selected by 
the sponsor as among his best one year and eight months after Follow 
Through programs began. Of the classes observed, 14 were rated as 
being over 90% implemented according to sponsor goals, only four classes 
were rated below 80% implementation, and one was rated below 50%. 

When sponsor groupings are considered, Group 1 classrooms showed 
an average of 917o implementation. This group is the most prescriptive 
in its approach, and it is likely to be easier to train teachers when 
goals and procedures are clearly defined than when they are general. 
Groups 2 and 3 had classes that averaged 82% and 83%,, respectively, in 
implementation. These models are more global in their view of child 
education, and it is more difficult to specify the classroom processes 
that will gain their desired child outcomes. 
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Characteristics of Follow Through and Non-Follow Through Teacher s 



The main source of data on the characteristics of Follow Through 
and non-Follow through teachers was a questionnaire (See Appendix 7). 
rt was distributed through local Follow Through Directors to 1,160 
Follow Through and non-Follcw Through teachers and 775 aides and assis- 
tants. Responses were mailed directly to SRI and were received from 
j.,003 teachers and 640 aides and assistants, or 86% of the teachers 
(90% of the Follow Through teachers and 80% of the non-Follow Through 
teachers) and 86% of the aides and assistants, 

A major long term purpose of the teacher survey is to provide an 
economical, acceptably reliable, and valid description of program proc- 
esses and certain outcomes. Direct observation of more than a small 
number of classrooms is not economically feasible. Nevertheless, with- 
out descriptions of what occurs, it is not possible to characterize 
children's classroom experiences in sufficient detail to account for 
observed variation in their performance. The teacher questionnaire 
approach complements the classroom observations and provides certain 
hands of information that are available only from the teachers themselve 
Such data could be obtained by interview but the response rate realized 
in the Spring of 1970 holds hope for the self-report questionnaire to be 
as effective and considerably more economical than interviews. 

A full analysis of the teacher and aide survey has not yet been 
completed. The results reported below are preliminary and intentionally 
selective in their coverage. 



General Characteristics of the Teachers 

Some general characteristics of Follow Through and non-Follow 
Through teachers are summarized in Table 6. Several features are 
notable ; 

Cl) The younger age of Follow Through teachers at f. ach grade 
level except second grade. 

( 2 ) The overall similarities but variations across grades in 
ethnic background. 

( 3 ) The similarities in formal academic preparation. 

( 4 ) The differences between Follow Through and non-Follow 
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Table 6 



SELECTED CHARACTERISTICS OF FOLLOW THROUGH 
AND NON-FOLLOW THROUGH TEACHERS 



Follow Through 



Non-Follow Through 



1. Median age in years, by grade: 



K 


30.0 


35.0 


E-1 


36.1 


41.7 


NE-1 


30.9 ' 


36.5 


2 


36,7 


35.5 


3 


38.5 


46.0 




Follow Through 


Non-Follow Through 



2. Percent in major ethnic 
groups, by grade 



K 

E-1 

NE-r 

2 



Total 



Black 


White 


All other 
8t No Ans. 


Black 


White 


All Other 
& No Ans. 


26.2% 


65.4% 


8.5% 


29 . 2% 


62 .0% 


8.8% 


39.4 


56.1 


4.6 


29.4 


61.8 


8.8 


37.9 


54.0 




29.2 


69.2 


1.5 


34.3 


57.1 


/■ 8.6 


24.5 


60.4 


15.1 


14.3 


85.7 


0.0 


33.3 


55.6 


11.1 


32.4 


60.1 


7.5 


28.6 


63.0 


8.4; 
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F ollow Throligh 



3. Percent; holding bachelors 
d egr ee or hi gher 









96.1% 



Non r?Fol low Through * 

96 '. 2 % ,• ■ 






A\ Percent holding highest 

‘ of / cert if 1^^ granted ; by 

grade iv, 









E-1 

NE-1 

2 

3 



38.5 
47.7 
47.2 
52. 4 
50.0 



38.5 
52.9 
60 . 0 
45.3 

55.6 



5. Percent holding tenure status, 
by grade 



K 

E-1 

NE-1 

2 

3 



45.9 

53.0 

56 . 9 

57.1 
57.1 



60.2 

55.9 

59.4 

41. 5 

55.6 
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Table 6 (concluded) 

SELECTED CHARACTERISTICS OF FOLT.OW THROUGH 
AND NON-FOLLOW THROUGH TEACHERS 



Follow Through 

Median years of teaching 
experience, by grade 

4.8% 

9.9 
5.7 
6.2 
5.5 



L-i 

NE-1 

2 

3 



Percent reporting prior formal 
training in teaching di-iiad- 
vantaged children, by grade 



K 


53.8 


E-1 


60.3 


NE-1 


46.8 


2 


60.2 


3 


71.4 



Total 53.7 

Percent reporting such train- 
ing whoj found it ’’very’’ \ 
helpful, by grade 




• - • .-• ••• • ■■■' • •• 

Total ^ 



K. 


49.7 


E-1 


-72.2 


NE-1 : 


49.3 




72,6 


3.- ■; 


30,0 




57,6 






Non-Follow Through 



6.4% 

12.1 

6.5 

8.3 

over 20 



48.2 

48.3 
39.7 
38.0 

44.4 

43.5 



47.4 

69.0 

36.0 
63,2 
SO . 0 







Cs) The tendency for more non-Follow Through teachers to 
enjoy tenure status, particularly at kindergarten. 

(e) differences between Follow Through and non-Follow Through 
teachers in number of years of teaching experience, con- 
sistent with the age differences noted earlier. 

Two kinds of findings from the teacher survey are highlighted in 
his report. One compares and contrasts Follow Through teachers across 
gra e eve s and according to sponsor groups on such questions as (l) 

support received from Follow Through spon- 
ors, (2; the desire for additional support from sponsors, and (s) the 
perceived advantages in teaching in Follow Through. The second class of 
findings are delimited in this report to kindergarten teachers and re- 
late teacher characteristics to pupil performance on school achievement 
measures. These data are described in Section VIII. 



mfferences Among Teacher Responses According to Snonsor Group 
and Grade ~ ~ 



Table 7 



summarizes the reports of Follow Through teachers regard- 



y have received from 



ing the kinds of training and oth(^r support , th 

sponsors. In the top half of the table, these data are suminarlzed ac- 
cording to sponsor group and in the bottom half they are summarized by 
grade level. The table shows that the: three major sponsor groups; fl, 2, 
and^3) are similar to one . another in the pattern of train ahd ^pporF 

not imply that the substance of the 
training, equipment, and materials is identical but simply that the 
general level^ d support is comparable. 

\ Sponsor Group 2 was somewhat less likely than Sponsor Groups 1 and 
3 to provide. training prior to school but was more likely than the other 
t.vo sponsor groups to provide training during school. Sponsor Groups 
1 and 2 provide somewhat more equipment than Sponsor Group 3. Sponsor 
roup 1, in keeping with the more structured character of its instruc- 
lona progr™, was more likely than Sponsor Groups 2 and 3 to supply 
materials. All three groups also provided a high level of support in 
terms of individual consultations to teachers and visits from the sponsor 

Sponsor Groups 4 and 5 contrast to the other three Both 

h bhe charterer of vthe^^^^^t^^^^ ^ self -sponsored 

projects and Sponsor Group 5 are parent-implemented projects). 
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The portion of Table 7 that displays sponsor support according to 
grade xevel shows less variation than the support according to group. 
Most of the variation across grade levels is accounted for by the grade 
level distributions within the different sponsor groupings. 

xable 8 is limited to the spc '^-r groupings and shows the percent- 
age of teachers in each group who had suggestions to make regarding ad- 
ditional support that the sponsors should provide. The differences be- 
i-ween groups in this table provide a rough index of the extent to which 
the teachers appear satisfied with the kinds of support summarized in 
the previous table. In keeping with the more self-sufficient character 
of the programs in Sponsor Groups 4 and 5, these are the two in which 
the highest proportion of teachers had no suggestions for additional 
support. Among the three larger groupings, Sponsor Group 1, closely 
followed by Sponsor Group 3, reflected fewer requests for additional 
sponsor support. The differences among sponsor groupings is statisti- 
cally significant, as shown in the table footnote (p < .OOl). 

Table 9 is similar in layout to Table 7 presented earlier; it 
shows the percentage of teachers, by sponsor group and then by grade 
level, who did or did not perceive advantage to teaching in a Follow 
Through program. Some differences among sponsor groups are detectable. 
For example. Sponsor Group 1 shows greater variability in response than 
do the other sponsor groups. A higher percentage of teachers in Sponsor 
Group 1 reported much (not just some) advantage to teaching in Follow 
Through but, at the same time, higher percentages either did not see 
any advantage to teaching in Follow Through or were unwilling to commit 
themselves ( don 't know ) . The overall differences between sponsor 
grpups approached statistical significance ( . 10 > p > .05 by chi square). 

In the classification of teachers according to grade, some small 
again notable. For example, kindergarten teachers are 
more likely than teachers at higher grades to perceive much advantage 
in teaching in Follow Through. The overall differences in this tabu- 
lation also approached statistical significance (.10 >p > .05). 



Table 8 



PERCENT OF FOLLOW THROUGH TEACHERS IN EACH F ^ONSOR 
GROUP SUGGESTING VARIOUS KINDS OP ADDITIONAL 
NEEDED SUPPORT FROM SPONSORS 



Follow Through 
Teachers in 


Percent Suggesting 
Additional Support 


Total 




Sponsor Group 


None 


Some 


Percent 


Number 


1 


43.1% 


56 . 9% 


100% 


211 


2 


29.2 


70.8 


100 


154 


3 


39.2 


60.8 


100 


227 


4 and 5 


64.1 


35.9 


100 


103 


All Follow 










Through Teachers 


41 . 9% 


5h . 1% 


100% 


695 


Chi square = 31.79, 


p < . 001. 


Contingency 


coefficient = 


.209 



Tab le 9 



PERCENT OF FOLLOW THROUGH TEACHERS REPORTING AN 
ADVANTAGE TO TEACHING IN A FOLLOW THROUGH PROGRAM 





No Re- 
sponse 


Much 

Advantage 


Some 

Advantage 


Sponsor 

Group 


1 


1.4% 


65.4% 


18.0% 


2 


1.9 


58.4 


31.2 


3 


0.4 


62.1 


29.1 


4 


0.0 


62.6 


27.7 


5 


5,0 


60.0 


20.0 


Total 


1.2% 


62 . 3% 


25.8% 


Grades 


K 


1.1% 


67.8% 


20.5% 


E-1 


2.3 


63.6 


27.3 


NE-1 


0.6 


56.5 


29.2 


2 


1.0 


54.3 


32.4 


3 


0.0 


64.3 


28.6 


Total 


1.2% 


62.3% 


25.8% 



No 


Don ' t 


Total 


Advantage 


Know 


Percent Number 



8.1% 


7.1% 


ioo% 


211 


3.9 


4.5 


100 


154 


3. 5 


4.8 


100 


227 


3.6 


6,0 


100 


83 


5.0 


10.0 


100 


20 


5 . 0% 


5.8% 


100% 


695 


5 . 0% 


5.6% 


100% 


283 


3.0 


3.8 


100 


132 


5.0 


8.7 


100 


161 


7.6 


4.8 


100 


105 


7. 1 


0.0 


100 


14 


5 . 0% 


5.8% 


100% 


695 









VI FAMILIES AND HOMES 



Data regarding families and homes are important to the evaiuatiisn 
for a number of reasons. One is that such data are needed to identify 
subsets of children in Follow Through and in the non-Follow Through 
comparison groups that are similar in socioeconomic and certain; other- 
family characteristics that might be related to the educational proogress 
of the child. Another important reason is that the Follow Through Guide- 
lines require parent participation in the local Follow Through program 
in the belief that the school and the community should be opened up to 
each other for the benefit of the home as well as of the child and school. 

This section contains a summary of comparisons between Follow TL . ough 
and non-Follow Through groups for selected descriptive, mediating, and 
outcome variables. All of the comparisons presented in this section are 
between Follow Through and non-Follow Through groups that SRI classified 
as Certain poverty or Possible poverty according to the OEO povert]/ 
index. All the children included also must have completed the full set 
of achievement tests given in both Fall 1969 and Spring 1970, and their 
parents must have been interviewed as a part of the parent survey. Data 
are not presented for third graders, because their parents were not 
interviewed. Children that meet all these criteria total somewhat more 
than 2,000 depending on the specific variable of interest. 

Detailed definitions and the sources of the variables used in this 
section are given in Appendix 8. The variables are organized into three 
broad classes: 



(1) Demographic characteristics 

( 2 ) Family life style 

( 3 ) Parent awareness of and participation in Follow Through 
and other school activities. 



Demographic Characteristics 



Twelve variables fall in this class: 

(1) Sex of child 

(2) Age of child 

(3) Preschool experience of child 

(4) Ethnicity 

(5) Sex of household head 

( 6 ) Occupation of household head 

(7) Employment status of household head 
(s) Education of household head 

(9) Education of spouse 

(10) Family income 

(11) Family size 

(12) Home ownership 



As summarized in Table 10 , on only five of these 12 variables do 
there appear to be differences worth noting between Follow Through and 
non-Follow Through groups— age of child, preschool experience of child, 
ethnicity, education of household head, and education of spouse. 

Follow Through and non-Follow Through children tend to differ some- 
what on both age and preschool experience. Generally, non-Follow Through 
children are slightly older . The difference between median ages is small 
t seldom more than a few months) but the age distributions differ enough 
to warrant the generalization. 

non-Follow Through children are very different 
according to preschool experience. At ail grade levels, and most strik- 
ingly at kindergarten and entering first, the proportion of Follow Through 
Children with prior Head Start experience greatly exceeds that for non- 
Follow Through and the proportion of non-Follow Through children without 
preschool experience greatly exceeds that for Follow Through. Typically, 
these differences are significant at or below; the .001 level. 







Table 10 



SUMMARY OF COMPARISONS OF FOLLOW THROUGH AND NON-K)LLOW THROUGH 
FAMILIES ON DEMOGRAPHIC CHARACTERISTICS* 



Variables on Wliich FT and NFT Were Essentially Similar '*' 
Sex of child 
Sex of household head 
Occupation of household head 
Employment status of household head 
Family income 
Family size 
Home ownership 



Variables on Which FT 
and NFT Plffered T" 

Age of child 



Preschool experience of child 




r . . Ethnic i ty 




Education of household head 
Education of spouse 



Nature of Difference 

Median age of FT and NFT children essentially 
equal ; NFT children showed slightly greater age 
range . 

Averages over all grade levels: 

FT - 40% Head Start, 20% Head Start equivalent 
or both Head Start and equivalent , 40% no 
preschool. 

NFT - 17% Head Start, 12% Head Start equivalent 
or both Head Startvand equivalent, 71% no 
preschool, 

FT and NFT approximately equal in proportion 
black. FT exceeded NFT in proportion non^black 
minority, NFT exceeded FT in proportion white. 

FT slightly greater than NFT in median years of 
school completed. 

FT slightly greater than NFT in median years of 
school completed. 



* See Appendix 8 for detailed definition of variables. 

^Similar defined as p > . 10 for chi square of FT vs NFT by variable. 
Differed defined as p ^ .10 for chi square of FT vs NFT by variable. 
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The proportion of black pupils in Follow Through and non-Follow 
Througii is reasonably similar across all grade levels and between sponsor 
groups combined across grade levels. There are some variations, to be 
sure, within sponsor groups and in certain projects. The ethnic categoric, 
on which Follow Through and non-Follow Through tend to differ, leading to 
an overall difference in the ethnic distribution, is in the proportion 
of white pupils and non-black minority pupils. Generally speaking, non- 
Follow Through has a higher proportion of white pupils and a lower pro- 
portion of non* black minority pupils. The probability of this difference 
overall is about . 05 . 

The educational attainment of both the household head and spouse 
tends to favor Follow Through children at entering first, non-entering 
and second grades. In at least one— third of all the comparisons 
examined (four grade levels and three or four sponsor groups), the 
differences were significant at the .05 level or less. The magnitude 
of the difference is modest— usually less than a year or two of school. 
Where differences were observed, the median level of educational attain- 
ment for Follow Through parents is usually in the "some high school" 
category , whereas the median for non— Follow Through is closer to eight 
years school. The association between the educational attainment of 
the household head and that of the spouse seems very high, as would be 
expected. 



Family Life Style 

Nine variables were selected as descriptive of family life style: 

(1) Imitative behavior 

(2) Parent/child mutual help 

(3) Child helps father 

(4) Home reinforces school/child relationships 

(5) Experiences beyond the home and neighborhood 

(b) Fate control (parent feelings about v/ork vs luck) 

(.7) Fate control (parent acceptance of fate) 

(s) Fate control (parent confidence in plans) 

(9) Expectations of job success for household head. 






9d 
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As sumnarxzed in Table 11 , there were very lew instances of any 
liierenoe, and even fewer of significant differences, between Follow 
rough and non-Pollow Through on these variables according to grade 
level and sponsor group. On two of them-parent/ohild mutual help, and 
^periences beyond the home and neighborhood-overall differences tended 
lo T Through families at a significance level of about 

sharper differences within some sponsor 
groups at some grade levels, but the general impression of overall 
similarity between Follow Through and non-Follow Through emerges. 



Parent Awareness of 



and Participation in School Actlviti^g 



This set of variables represents outcomes sought by Follow Through 
generally and by most sponsors. The set is composed of 14 variables: 



(1) Awareness of classroom activities 

(2) Parent/school contacts beyond the classroom 

(3) Parent works in classroom or school 

(4) Visits to classroom by family members 

(5) Recency of talks between parent and teacher 

( 6 ) Parent aspirations for child during school 

(7) Parent aspirctions for child following school 
(s) Parent general satisfaction with child's school 
(9) Parent sense of influence or control over school 

(10) Parent feelings that his ideas matter to those who run the 
schools 

(11) Parent confidence and optimism in school matters 

(12) Parent sense of helplessness in school matters 

(13) Parent involvement in social and political groups 

114) Follow Through parents’ awareness of the Policy Advisory 
Committee. 



■ these 14 variables— the exceptions are 6 , 7 , 11, and 12 

M e above list— some differences between Follow Through and non-Follow 
Through parental behavior is evident and appear to be statistically 
reliable. These are shown in Table 12 . 



Table 11 

SUMMARY OF COMPARISONS OF FOLLOW THROUGH AND NON-FOLLOW THROUGH 
FAMILIES ON FAMILY LIFE STYLE* 

Variables on Which FT and NFT Were Essentially Similar '^' 

Imitative behavior 
Child helps father 

Home reinforces school/child relationships ? 

Fate control (work over luck) ’ 

Fate control (acceptance of fate) ^ / . 

Fate control (confidence in plans) 



Expectations of job success for household head 




At graae ij;-x and 2 , NFT families tended 




Nature of Differ eric 





t 



Appendix 8 for detailed definition of variables. 

Similar** defined as p > .10 for chi square of FT vs NFT by variable. 
Differed' defined as p ^ .10 for chi square of FT vs NFT by variable. 



Table 12 

SUMMARY OF COMPARISONS OF FOLLOW THROUGH AND NON-POLLOW THROUGH 
FAMILIES ON PARENT AWARENESS OF AND PARTICIPATION IN SCHOOL ACTIVITIES* 

Variables on Which FT an d NFT Were Essentially Sli.n «r. t 

Parent aspirations for child during school 
Parent aspirations for child following school 

Parent confidence and optimism in school matters 
Parent sense of helplessness in school matters 



Variables on Which FT 
and NFT Differed '^ 

Awareness of classroom activities 



Parent/school contacts beyond 
the classroom 

Parent works in classroom or 
school 'f 



Visits to classroom by family 
members 



Recency of parent/teacher talks 



general satisfaction with 
child’s school 

Parent sense of influence and 
control over school 

Parent feelings that his ideas 

matter to those who run the 
schools 

Parent involvement in social and 
political groups 



FT parents’ awarene^ts of the PAC 



Nature of Difference 



FT parents exceeded NFT parents at all grade levels- 
differences marginally significant at K, clearly 
signifxcant at E -1 and NE-1, not significant at 2. 

FT parents exceeded NFT parents ; differences clearly 
■ grade levels except 2, 

FT parents more likely than NFT parents to work for ^ 
pay or as volunteer in school or classroom; differeRce 
P = .05 or less at all grade levels except 2 where 
P = .11. 

FT families more likely to visit classroom than NFT/ 

clearly significant at E-1 anil 
NE-1, marginally significant at K, not significant ■ 

’ at 2 , 

FT parents more likely than NFT parents to ha#e h^d 
talks With teacher within the past month; differences 
significant at K, E- 1 , and NE-1, but not at 2. ! 

Overall relationship weak but favors FT; significant 
at K, not significant at higher grades. j' 

FT parents exceed 
of influence at K 
not significant. 



NFT parents significantly in sense 
and E-1; differences at NE-1 and 2 



FT parents exceed NFT parents at K and E-1 ih feWing 
that their ideas matter; differences not significant 
but favor FT at NE-1 and 2. 

FT parents have higher sense of efficacy than NFT 
parents; differences significant at K and NE-1 

marginally significant at E-1, not significant ’at 2. 
ff Group 2 significantly more aware 

of PAC than FT parents in other sponsor groups. 



t of variables. 

^ ^ * square of FT vs NFT by variable, 

r defined as p S , lo for chi square of FT vs NFT by variable. 
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Follow Through parents are more aware of classroom activities than 
are non-Follow Through parents. The differences are greatest at entering 
and non-entering first grades (p < .Ol), approach a significant difference 
at kindergarten (p .15), and do not appear significant at second grade. 



Follow Through parents are much more likely than non-Follow Through 
parents to have contacts with school personnel other than the teacher 
(the principal, school nurse, or social worker). These differences 
are significant at the .02 level at kindergarten, at .001 level in both 
the first grade groups, and at about .15 at second grade. 



Follow Through parents are more likely than non-Follow Through 
parents to work in the classroom either for pay or as volunteers. 

Overall, the reliability of this difference is about .02. 

Follow Through parents are more likely than non-Follow Through 
parents to liaye visited the classroom one or more times. The differences 
are greatest in first grade (botii entering and non-entering), clearly 
significant at second grade, and perhaps not significant at kindergarten. 

Parents of Follow Through children at kindergarten, entering first, 
and non-entering first levels are more likely to have had talks with 
teachers and to Jia^ye had these conversations more recently than are 
non-Follow Through parents. Overall, the differences at second grade 
are not significant. 

Parent general satisfaction with the child 's school does not show 
sharp differences between Follow Through and non-Follow Through, although 
somewhat more Follow Through than non-Follow Through parents at all levels 
are likely to express high satisfaction. At the kindergarten level, the 
difference is significant at the .01 level. The differences are not 

statistically significant in the higher-grade groups, however. 

Follow Through parents of both kindergartners and entering first 
grade children report a somewhat greater sense of influence and control 
over the school than do non-Follow Through parents. The clearest dif- 
ference between Follow Through and non-Follow Through occurs at the 

kindergarten level (p < .02); there is a marginal difference (p < .lo) 

at entering first. At the higher grade levels, the differences are 
not significant. • , 




Follow Through parents of children at kindergarten and entering 
first grade are more likely than non-Follcw Tnrough parents to report 
that their ideas matter to those running the schools. At non-entering 
first, the difference is not significant, and the differences at second 
grade are suggestive hut not great (p < ,20). 

F9II0W Through parents are somewhat more likely than non-Follow 
Through parents to participate in adult groups (such as social organiza- 
tions, PTA, parents’ clubs). The differences are statistically signifi- 
cant at both kindergarten and non-entering first (p < .02 and p < .01, 

respectively) but are simply suggestive at entering first and second 
grade levels. 



There are obvious differences between Follow Through and non— Follow 
Through parents in their awareness of the PAG, as would be expected. 
There are also some differences within the Follow Through parent group 
according to the sponsor group. Follow Through parents in Sponsor 
Group 2 are more likely than parents in the other sponsor groups to 
indicate knowledge of PAG. 
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VII THE CHILDREN 



As stated earlier, improving the life chances of poor children is 
the ultimate aim of Follow Through. Identifying the educational prac- 
tices that will maximize the chances for poor children to enjoy self- 
confident, productive, constructive lives is a difficult task. Indeed, 
even finding agreement among authorities and men of good will on a common 
set of things that children ought to know and believe when they are five, 
six, seven, or eight years old so that they will be likely to enjoy 
fruitful lives is in itself no mean assignment. Most agree that children 
must develop effective habits of learning, acquire a positive desire to 
learn, and master skills by which the culture is: -ixansmittcetl and extended. 
Such accomplishments may not be sufficient cosE^itntions forz^^suring self—: 
confident, productive, and constructive lives bmt: iew wouILd! deny their 
necessity. 



The three primary measures presented in ifJras section are pupil 
academic achievement, attitudes coward school, ;^d interpersonal feel- 
ings. The measures of achievement were obtained from a test battery 
(described in Appendix 4) that provides indicators of verbal/linguistic 
skills, quantitative/ computational skills, and perceptual/motor skills. 
Each of these major categories may be broken down into more explicit 
factors. To keep the amount of data to be reported within reasonable 
bounds, however, achievement test scores were consolidated into a single 
score and data presented in this section are based on this total. 

The measure of attitudes toward school reflects children’s responses 
to questions about their feelings toward school and learning new things. 
The interpersonal feelings score represents their feelings toward teachers 
and classmates. 

Additional measures concerned v/ith non-cognitive growth (e.g., task 
persistence, curiosity, and internalized acceptance of responsibility for 
success and failure) are also reported for a judgmental subsample of 
children. 



Data presented in this seotiz-kM -i 

between Follow Through and non-Foll differences and similarities 

following variables; ^ J^ough children according to the 



( 1 ) 

( 2 ) 

C3) 

(4) 

(5) 



Level of poverty 
Preschool experience 

Extent Of Pollo„ Throueh eervices received 
Grade level 

Follow Through model or approach experienced. 



As noted at the bottom of the • 

results on these variables Aonenri * section that summarize the 

more detail. ^^^^les, Appendxx A presents the tabulated data in 

shipe^L::; elation. 

medxating variables, such as teacher charLt'^^^'^^'^"'® and other 

style, are presented^ - ea^xstxes amid family ;i if e 



Pupil Outcome Measures; Achievement, Attitudes Toward Scho ol , 
and Interpersonal Feelings 

Discussed below are pupil performance and beliefs on thiree outcome 
measures: (l) the achievement test ibastery in its various grade level 

versions, (2) an "attitudes toward schtool" scale, and (s) an "interper- 
sonal feelings" scale.* 



The achievfranent battery was described briefly in Section III and in 
mofre detail in j^pendix 4. 



The two attitude measures were based on pupils ' respornses to sraz-en 
questions that were part of the tests administered to all children iim "the 
study sample in. th.e Fall of lS6i9 and Spring of 1970. The attitudes ifecnward 
school scale iaociLuded three questions asking the pupil to indicate imw he 
felt (a) about learning cmt of books, (b) what he thinks alijoiat comii^ to 
school in the iiumrming , amd (c) how he feels about learning mew things.. 

The pupils expressed their feeling on each of these questions by marking 
one of three taces in the test booklet — a smiling face ( feeling happF or 
good), a straight face (feeling neither particularly bad nor good), and 
a frowning face ( feeling unhappy or not good). 



The interpersonal feelings scale included two sets of paired items 
or four in all. One pair asked how the child felt about other boys and 
girls in his school, ahd its reciprocal asked how he thought other boys 
and girls in his school feit about him. The other pair of questions 
asked how the child felt about his teacher, and the companion question 
asked how he thought the teacher felt about him. Again, the pupils showed 
their response by marking a smiling face, a straight face, or a frowning 
face. 

The findings on these outcome measures of school achievement, atti- 
tudes toward school, and interpersonal feelings are organized to address 
two classes of objectives central to Follow Through as a national program 
and the planned variation experiment within Follow Through. The first 
set includes the social policy issues that give meaning to Follow Through. 
By legislative and program intent. Follow Through is for poor children 



A subsequent section of the report will present additional data com- 
paring Follow Through and non-Fol low Through children on a substantially 
larger number of noncognitive measures. These additional measures of 
noncognitive variables, however, we^ limited to a Judgmental sample 
of, about 850 chi Idren in eight pro j ects. 




with preference to those who experienced Head Starrt (or its locally 
defined eqaiLv^alent ) prior to enrollment in regular school. Once ,en- 

Foillow Through, a child may receive the full array of services 
that the Follow Through Guidelines prescribe or he may receive osly some 
of them. ( !^3r example, Follow Through Guidelines permit some pugsils to 
be drawn frcmn families that do not fall within the OEO definitioEt of 
proverty. ffiowever, only children from low income families, as dG=rfined 
by the OEO proverty index, are eligible to receiv’s the full ranges of 
services.) Thus, level of poverty, type of pressrhool experiences,, and 
range of services received constitute three central policy varia:biLes in 
the evaluation of Follow Tbirough. 

The second set of questions concerns the differential effects of the 
Follow Through models or approaches. When comparing approaches, She pri- 
mary classification of the data are into groupings of sponsors acEording 
to gross theoretical and procedural similarities., jas already described 
in Section TV. 

FinaJLly , the data are also organized according to grade level so 
that the direction and magnitude of the effects may be examined in light 
of the length of time that a child has participated in Follow Through. 
Data from the entering year in Follow Through — either kindergarten or 
entering first grade — are by far the most important data available at 
this time. Children at these grade levels in 1969-70 constitute the 
first generation of pupils who experienced a reasonably well implemented 
and refined approach. This is not meant to discount fully the data for 
children at higher grade levels (non-entering first, second, and third) 
but is intended to emphasize the importance of the entering . grade levels 
relative to the later ones. 
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standardization of Scores on Pupil Measures 



Pupil performance on the achievement battery varied widely from one 
geographical pILace to another. Appendix Tables A-1 through A-4 show 
this phenomenon. These tables display the mean scores by grade level 
for both Follow Through and non-Follow Through pupils in 86 projects in 
which achiewemexrt tests were administered in Fall 1969. The tables show 
two things tlhat have an important influence on the way in which data 
have been treated in the analyses that follow: (l) the range of dif- 

ference from place to place and ( 2 ) the similarities and dissimilarities 
between Follow Through and non-Follow Through groups within projects. 

Table 13 shows the raw score means for each grade level over all 
projects. The first row within each grade level shows the mean over all 
pupils and the standard deviation of that score distribution. The sec- 
ond row shows the project means and the standard deviation of this dis- 
tribution of project means. The scores in Table 13 and in the Appen- 
dix A Tables A-1 through A-4 are mean percent correct of all items 
administered. (See Appendix 4 for a summary of the number of items in 
each grade level battery according to a gross classification of content. ) 

At the kindergarten level, individual project means within Follow 
Through ranged from a low of 28.897o correct to a high of 65.727o correct. 
Within the non-Follow Through group, the range was from a low of 32.387o 
correct to a high of 65.887o correct. The Follow Through and non-Follow 
Through distributions are similar but far from identical; the correla- 
tion between the Follow Through and non-Follow Through distributions by 
project is .566. 



The score range by project at entering first grade for Follow 
Through was from a low of 54.117o correct to a high of 74 . 04 % correct. 

An even greater range obtained within the non-Follow Through group where 
the lowest mean was 51.517. correct and the highest was 83 . 35 % correct. 
The correlation between the Follow Through and non-Follow Through dis- 
tributions was .381. 



At the non-entering first grade level, the range of project means 
was from 30.66% correct to 62.38% correct for Follow Through. The non- 
Follow Through scores were similar, ranging from 33 . 88 % correct to 33 . 29 % 
correct. The two distributions correlated .401. 



At the second grade level, the project means ranged from 38.567. 
correct to 68.95% correct for Follow Through and, for non-Follow Through, 

from 40.26% correct to 79.857. correct. The correlation between these 
distributions was .545. 
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Table 13 



MEAN PERCENT CORRECT ON ACHIEVEMENT BATTERY FOR PUPILS 
AND PROJECTS AT VARIOUS GRADE LEVELS 
(Fall I960) 



Follow Through Non~Follow Through 

Standard Standard 

P^vl^tion Number Mean Deviation 



Grade Tie vrel 


Unit 


Number 


Mean 


Kindergarten 


Pupil 

Project 


6,249 

59 


45.27 

44.86 


Entering 

First 


Pupil 

Project 


2,774 

23 


65.71 

65.18 


Non~Entering 

First 


Pupil 

Project 


3 , 286 
48 


45.46 

45.97 


Second 


Pupil 

Project 


2,216 

35 


54 . 99 
54 . 03 


Thi rd 


Pupil 
Pro j ect 


239 

.. 4 


38.60 

36.62 



16.65 
7. 68 


3, 688 
59 


44.93 

45.90 


16.84 

8.08 


15.50 

6.23 


1,628 

23 


68.83 

69.08 


14 . 69 
6.45 


12.64 

7.42 


2,147 

48 


48. 12 
48.69 


12.31 

7.00 


15.66 

8.51 


1,424 

35 


59.35 

60.77 


16.47 

9.66 


13.71 

6.44 


134 

4 


39.19 

38.45 


11.15 

4.78 
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As these data suggest and the appendix tables affirm, simple aggre- 
gation of test scores from one project to another to provide indications 
of differences between Follow Through and non-Follow Through according 
to sponsor groupings or some other classification could be seriously 
misleading. In well over half of the projects, the differences between 
Follow Through and non-Follow Through groups on the raw score means was 
statistically significant. Thus, even though the correlations coeffi- 
cients suggest a moderate similarity between the Follow Through and non- 
Follow Through samples in initial achievement test performance, it is 

clear that place- to-place comparisons that assumed similarity would be 
unwarranted. 

In addition to dissimilarities between Follow Through and non- 
Follow Through groups within projects, the range of differences among 
projects within a sponsor group classification was also large, thus 

cautioning against simple summation as a means for showing sponsor group 
averages. 

The approach adopted in the analyses reported here was to stan- 
dardize the score distributions for each district individually at each 
grade level. Briefly, the procedure pooled all Follow Through and non- 
Follow Through pupil scores for both Fall and Spring combined into a 
single distribution whose mean was set equal to 50 with a standard de- 
viation of 10 . Each score was then expressed as a standard score with 
reference to these values. The distribution was then disaggregated and 
reassembled into Fall and Spring distributions for both Follow Through 
and non-Follow Through. 

All the pupil achievement data presented in this report, with the 
exception of Table 13 and Appendix Tables A-l through A-4 referred to 
above, are shown in standard score form. Other pupil measures, such as 
the scores on the scale of attitudes toward school and learning and the 
interpersonal feelings scale, were also standardized by an identical 
procedure. The effect of the standardization has been to eliminate very 
largely the inter-district or inter-project variability from the con- 
trasts of Follow Through and non-Follow Through pupils. It is not pos- 
sible, therefore, to draw comparisons from one project to another based 
on the standardized scores. It is possible, however, to look from proj- 
ject to project or from one group of projects to another at the differ- 
ences between Follow Through and non-Follow Through, These differences, 
expressed in standard score terms and summed across projects classified 

in various ways, constitute the primary comparisons in the remainder of 
the report. 



The Outcome Measures Applied to Children from Lower 
Income Families 



As already noted, only children from low income families as defined 
by the OEO poverty line index are eligible to receive the full range of 
services provided by each Follow Through project. Data obtained from 
parents in face-to-face interviews during Spring 1970 were used to group 
children according to level of poverty. As explained in Appendix 1 , three 
groupings were derived; (l) children from families that certainly fall 
below the OEO poverty line, ( 2 ) those from families that certainly do not 
meet the OEO definition, and (3) the remainder — referred to throughout 
the balance of the report as "Possible poverty" — ^for whom the data gath- 
ered in the parent interviews were too gross to allow classification as 
"Certain poverty" or "Not poverty." 

Of the families interviewed , about 35^ of those with a Follow Through 
child and about 41^ of those with a non— Follow Through child were cate- 
gorized as "Not poverty." In a strict sense, the data of greatest interest 
the other children--the 65^ of the Follow Through group and the 
59^ of the non-Fcllow Through group — and it is these children, in kinder- 
garten through grade two, to whom Tables 14, 15, and 16 apply (the data 
shown for grade three covers all poverty groups since parents of grade 
three children were excluded from the interview survey and therefore data 
on poverty are not available for these children). 

Table 14 displays achievement test results, Table 15 displays atti- 
tudes toward school , and Table 16 displays interpersonal feelings for 
Follow Through and non-Follow Through children. 

The kindergarten data in Table 14 show clear differences favoring 
Follow Through. Follow Through kindergartners began the 1969-70 school 
year at a measured achievement level slightly greater than their non- 
Follow Through counterparts. This difference of 1.03 standard score units 
approached statistical significance; that is, there are about 7 chances 
in 100 that the observed difference is accidental. By the end of the 
1969-70 school year, the difference between the Follow Through and non - 
Follow Through kindergartners had widened to a point where it can be Said 
with high confidence that the margin is a reliable one (p < .001). The 
fact of greater gain during the 1969-70 school year by Follow Through in 
contrast to non-Follow Through kindergartners was also statistically re- 
liable (p =“ .05). If one were to graph the Fall and Spring scores for 
Follow Through and non-Follow Through kindergartners , a diverging pair 
of lines would be shown. Follow Through kindergartners began the year 
slightly ahead and completed the year still further ahead 



Table 14 

ACHIEVEMENT TEST SCORES FOR FOLLOW THROUGH AND NON-FOLLOW 
THROUGH PUPILS CLASSIFIED AS "CERTAIN POVERTY" AND 
"possible POVERTY, " 1969-1970 
(Standardized Scores) 



(FT)-(NFT) 







Follow 


Non-Follow 


Mean 


t- 




Grade Level 


Statistic 


Through 


Through 


Diff. 


Ratio 


p 


Kiadergarten 


No. Pupils 


741 


360 










Fall Mean 


43.49 


42.46 


1.03 


1.83 


<.07 




Spring Mean 


55.05 


53.27 


1 . 78 


3.42 


<.001 




(Spr)-(Fall) 


11.56 


10.81 


0.75 


1.96 


=-. 05 


Entering First 


No. Pupils 


436 


273 










Fall Mean 


42.31 


44.81 


-2.50 


-3.11 


<.002 




Spring Mean 


52.32 


53.19 


-0.87 


-1.42 


>. 10 




(Spr)-(Fall) 


10.00 


8.38 


1.63 


3.23 


<.002 


Non-Entering 


No. Pupils 


290 


57 








First 
















Fall Mean 


44.38 


46.36 


-1.97 


-1.81 


<.10 




Spring Mean 


54.94 


56.66 


-1.72 


-1.33 


>. 10 




(Spr)-(Fall) 


10 . 55 


10.30 


0.25 


0.33 


>.50 


Second 


No. Pupils 


89 


21 










Fall Mean 


43.87 


51.29 


-7.42 


-3.36 


<.002 


.. .. . .. ...... ... . 


Spring Mean 


51.20 


- 56.78 7 


-5.58' 


-2.44 


<. 02 " 




(Spr)-(Fall) 


7.33 


5.49 


1.83 


1.49 


>. 10 


Third 


No. Pupils 


239 


: 134 

■\v : 










Fall Mean > 


46.07 


45.97 


0.11 


0.12 


>.80 




Spring Mean 


53.67 


54.49 


-0.82 


-0.78 


>.20 




(Spr)-(Fall) 


7.60 


8.53 


-0.93 


-1.68 


<.10 



Note: See Appendix A for detailed summaries by poverty category and sponsor 

group. Achievement test data appear in Tables A-5 through A- 10 (kin- 
dergarten), A-23 through A-27 (entering first grade) ,A-38 through A-43 
(non-entering first grade), and A-56 through A-60 (second grade) , 

* ■ .. . 

Third grade data include all pupils; poverty classification not possible at 
this grade since interviews not conducted to obtain family income and family 
size information. 



For the other entering grade level — entering first — a somewhat dif- 
ferent picture emerges: Follow Through children began the year substan- 

tially behind their non-Follow Through counterparts. The magnitude of this 
difference was statistically significant (p <-,002). By the end of the 
year, however, much of this gap had been closed so that the difference 
at the end of the 1969-70 school year could not be considered reliable; 
in probability terms, the two groups would be judged as essentially equiv- 
alent on the achievement measure (p > .10). The gains demonstrated by 
Follow Through entering first graders were markedly larger than those 
shown by non-Follow Through entering first graders. The difference be- 
tween Follow Through and non-Follow Through in the Fall-to-Spring gain 
was clearly statistically significant (p < .002). Graphically the pattern 
for entering first graders, then, is that of converging development lines 
where Follow Through children closed much but not all of the gap that had 
obtained at the beginning of the school year. 

The picture is essentially^ indeterminate for the non-entering first 
grade (the children who began regular school at kindergarten).. Follow 
Through children started the year behind their non-Follow Thr^^gh compar- 
isons and ended the year without having closed this gap. The amount of 
change shown by both Follow Through and non-Follow Through was essentially 
equal (p > .50), The magnitude of the difference at the Spring point was 
not statistically significant (p>:i 0 ). 

The second grade data in Table 14 reveal substantial differences 
between the Follow Through and the non-Follow Through samples. The mean 
achievement score for Follow Through children in Spring of 1969-70. was 
virtually identical to the score for non-Follow Through second graders 
at the beginning of the year. The Follow Through second graders gained 
more during that year than did non-Follow Through children but not enough 
for the differential gain to be considered statistically significant 

(p > .10) .- 

Third grade figures reported In Table 14 do not differentiate chil- 
dren according to level of poverty. The third grade contrasts show a 
crossover in the change curves; the Follow Through children were slightly 
superior to non-Follow Through but not significantly so at the beginning 
of the school year. By the end of the school year the positions had re- 
versed but, again, the difference was not statistically significant. 

Tables in Appendix A identified in the note to Table 14 show greater 
detail on, achievement test measures. They also show the relative perfor- 
mance of Follow Through and non-Follow Through pupils in kindergarten 
through grade two according to two additional classifications not 

contained in Table 14--the Not poverty group included in the parent 



interviews and those children whose ptoverty level is not known since 
their parents were not included in the interview sample. 

Table 15 is organized to parallel Table 14 preceding; it contains 
data that contrast Follow Through and non-Follow Through children at each 
grade level on the measure of attitudes toward school. 

Two important caveats must be made with regard to the measures of 
attitudes toward school. The first is the fact that the scale used was 
scored in such a way that a lower score denotes a more positive attitude 
toward school than does a higher score. Because of this/ a negative (-) 
sign in Table 15 highlights a difference that is favorable to Follow 
Through. The second caution has to do with the psychometric qualities 
of the scale itself. It was short (only three items) and the distribu- 
tions of scores, both Fall and Spring, tended to be skewed: about 57^5 

of both the. Follow Through and non-Follow Through children provided a 
smiling face response at either Fall or Spring. These qualities of a 
brief scale and skewed response distribution limit the usefulness of this 
attitude measure. 

Weaknesses in the measure notwithstanding, it is notable that all 
groups of children, with the exception of Follow Through third graders, 
showed a shift to more positive attitudes toward school between the Fall 
and Spring measurement points. In general, however, the differences be- 
tween Follow Through and non-Follow Through were not statistically sig- 
nificant. At three grade levels — kindergarten, entering f irSjt , and 
non-entering first — ^Follow Through children showed greater increases in 
positive attitudes toward school than did non-Follow Through children. 

At the kindergarten level this difference was marginally significant 
(.10 >p > .05); at the entering first grade level the difference favor- 
ing Follow Through appeared reliable (p < .04); at the non-entering first 
grade level, however , the difference was not statistically significant, 
although it too was In the direction favoring Follow Through. At both 
the second and third grade levels, the difference favored non-Follow 
Through children; this difference was not statistically significant at 
the second grade but appeared to be so at third grade. (it should be 
re-emphasized that the third grade data do not differentiate according 

to poverty levels; hence third graders in Table 15 include the Not poverty 
group. ) 

Data from the scale that measured interpersonal feelings are sum- 
marized in Table 16. The same caveats that apply to the attitudes toward 
school scale also apply here— a negative score difference denotes a change 
toward more positive feelings, the scale itself is short (only four items), 

and the response distributions tend to be skewed. * 



Table 15 



THBOUGB and 

"poddibJ^ p"™ DeD-“r“ 

(Standardized Scores) 



Grade Level 
Kindei'garten 



Entering First 



Non-Entering 

First 



Second 



Third' 





Follow 

Through 


Non-Follow 

Through 





(FT)-(NFT) 


Statistic 


Mean 
Dif f . 


t- 


No. Pupils 


717 


370 




xxa t XO p 


Fall Mean 
Spring Mean 
(Spr)-(Fall) 


51.71 

49.49 

-2.22 


51. 15 
50.44 
-0. 17 


0.56 

-0.95 

-1.51 


0S2 >.80 
-1.52 >.10 
-1.73 >.05 


No. Pupils 


433 


281 






Fall Mean 
Spring Mean 
(Spr)-(Pali) 


52.97 

48.74 

-4.23 


51.58 
49 . 34 
-2 . 23 


1.39 
-0. 61 
-2.00 


1.76 >.05 
-0.84 >.20 
“2.09 <.04 


No. Pupils 


298 


63 






Fall Mean 

Spring M?>an 

(Spr)-(Fall) 


51,13 
48 . 62 
-2.51 


51.50 

50.02 

-1,43 


-0.37 

-1.40 

-1.03 


-0.25 >.80 

-1.08 >.20 

-0.57 >.50 


No. Pupils 


93 


23 






/-trail Mean 
Spring Mean 
(Spr)-(Fall) 


51.33 
50. .13 
-1.20 


52.25 

47.47 

-4.78 


-0.92 

2.66 

3.58 


--0.35 >.50 

1.25 >.20 

1.21 >.20 


No. Pupils 


260 


147 






Fall Mean 
Spring Mean 
(Spr)-(Fall) 


49 . 23 
49.92 
0.69 


51.75 

49.76 
-1.99 


-2.53 

0.16 

2.68 


-2.47 <.a'52 

0.15 >.80 

2.04 <.05 



■ - ■■■: 

ERIC 



Note: 






Lower score on 

school and learning; negative^dif Positive attitude toward 
Through perspective. crence (-) desirable from Follow 

sp„„AO. 

A-28 through A -32 ( entering first grade)' A (kindergarten), 

-i-t grade), and A -61 thrLg^ Cnon-enteri;, 

Third grade data include all DuDn=. 

this grade since interviews not cond^t°4^t^ °^®®sification not possible at 
Size information. ^ and family 

■■■■V-'- 



Table 16 



INTERPERSONAL FEELINGS SCORES FOR FOLTX»W THROUGH AND NOK-fOLLOW 
THROUGH PUPILS CLASSIFIED AS "uERTAIN POVERTY" AND 
"possible POVERTY/' 1909-1970 
(Standardized Scores} 



(FT)-(NFT) 







Follow 


Non-Follow 


Mean 


t- 




Grade Level 


Statistic 


Through 


Through 


Piff^ 


Ratlo 


P 


Kindergarten 


No. Pupils 


706 


354 








Full Mean 


51.17 


50.78 


0.39 


0-57 


>.50 




Spring Mean 


49.60 


50.03 


-0.43 


-0-68 


=-.50 




(Spr)-(Fall) 


-1.57 


-0.76 


-0.82 


-0-93 


>.20 


Entering First 


No, Pupils 


419 


273 










Fall Mean 


52 . 59 


51.36 


1.24 


1-53 


>.10 




Spring Mean 


50.39 


48.91 


I.4S 


2-02 


<.05 




(Spr)-(Fall) 


-2.21 


-2.45 


0.24 


0-25 


>.80 


Non-Entering 


No, Pupils 


303 


64 








First 


Fall Mean 


51.00 


50.18 


0.82 


0- 


>. 50 




Spring Mean 


49.55 


51.14 


-1.59 


-1- 13 


>.20 




(Spr)-(Fall) 


-1.44 


0.96 


-2.40 


-1.42 


>. 10 


Second 


No, Pupils 


91 


23 










Fall Mean 


53.08 


54.37 


-1.30 


-O.S2 


>.50 




Spring Mean 


49.82 


50.51 


-0.69 


-0.28 


>.50 




(Spr)-(Fall) 


-3.25 


-3.87 


0.61 


0-2o 


>.80 


Third 


No. Pupils 


257 


147 










Fall Mean 


49.96 


50;28 


-0.31 


-0.34 


>.50 




Spring Mean 


50.50 


49.85 


0.60 


0.74 


>.20 




(Spr)-<Fall) 


0.54 


-0.42 


0.90 


0.86 


>.20 



Note: Lower score on attitude measure denotes more positive interpersonal 

feelings toward school and learning; negative difference (-) desirable 
from Follow Through perspective. 

See Appendix A for detailed summaries by poverty categ;ory and sponsor 
group. Interpersonal feelings data appear in Tables A- 1 7 through 
A-22 (kindergarten), A-33 through A- 37 (entering first grade), A-50 
through A-55 (non-entering first grade), and A-66 through A-^O 
(second grade). 

Third grade data include all pupils; poverty classification not possible at this 
grade since interviews not conducted to obtain family incorae and family size 
information. 



The trends in interpersonal feelings are somewhat different than 
those shown previously in attitudes toward school. The attitudes toward 
school measure had suggested a fairly regular ordering of scores reveal- 
ing differences favoring Follow Through at the lower grades but not at 
the higher ones. On the interpersonal feelings measures the picture is 
erratic. Differences favor Follow Through but not significantly so at 
kindergarten and non-entering first grade and at second grade. Among 
entering first grade children and third grade children, however, the dif- 
ferences favor non-Pollow Through. Only at entering first grade, however, 
are any of these differences statistically significant. 

In summary: the findings on the achievement scores lead to the 

unequivocal conclusion that Follow Through objectives of increased school 
achievement were being realized in 1969—70 at the entering grade levels. 

For these children, who make up the first cohort group in the longitudinal 
e'^aluation, the trend is positive and strong. On the rate of change mea- 
sures, Follow Through children exceed non-Follow Through at both kinder- 
garten and entering first grade. At the kindergarten level, Follow Through 
children exceed non-Follow Through both in rate of gain and absolute level 
of achievement. At entering first grade, the rate of gain for Follow 
Through children is clearly sharper than that for non-Follow Through but 
non-Follow Through children are still somewhat higher (but not signifi- 
cantly So) in their measured achievement. 

The differences in measured attitudes are less dramatic but gener- 
ally show a favorable pattern, especially among the kindergartners . 





Three policy variables central 

are level of poverty, preschool erperLnce Through 

services received. Data are preseuloi i f’ “ °T Follow Through 

impact of these three variables on the ^“.'"‘arise the combined 

mant, attitudes toward school and Inlr h«=hleve 

Ihvels. interpersonal feelings at all grade 

An extensive set nt <-oki • 

data from which the sign (+ or -rtah^’*’''’^"' * contain the quantitative 
sign tables (17 through 25) suraraarizrth "nt® drawn.* These 

Through and non- Follow Through children * 1 Terences between Follow 

or pre, measure; ( 2 ) the Sprf^ or p!st°“ 
to-Fall difference. The rLjr\7reZLTT?' 

are possible. Two patterns (+++ anr t a ! Patterns of signs 

Follow Through and non-Follow Thvo„ i divergence between 

convergence. The third Pair of patternsTtr^!"'^ 

between Follow Through and non-Follow Through ^ ®i°aa°''er 




Follow Through effects expressed in nnj, • 
are shown in relation to preschool e:rn , ®‘*T®''e'"ent score differences 
by grade level in Table 17. The cell elassification 

table Shows the overall effects 

' -ro"gT"%t"Farr":ce"^^^^ exceeded non-Follow 

‘he Spring, and gai;ermW^^^^^ 

non-Follow Through pupils th ■ Spring than did 

table as +++. ® ^ P This pattern appears in the 



( 2 ) 



This pattern L sL"rfs‘X“.''^^ 



A— 7X throllcrTi A 1 AQ 

hrou.h A-109 present quantitative data in more detail. 
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Table 17 



DIRECTION OF DIFFERENCES BET'.VEEN FOLLOW THROUGH AND NON -FOLLOW THROUGH 
PUPILS AT ALL GRADES ON ACHIEVEMENT TEST SCORES OBTAINED FALL 
AND SPRING, 1969-70, BY PRESCHOOL EXPERIENCE AND 
POVERTY CLASSIFICATION* 









Poverty Classification 




Preschool 

Experience 


1969-70 
School Grade 


Certain 

Poverty 


Possible 

Poverty 


Not 

Poverty 
- 4- 


Unknown 


Total 


Head Start 


Kindergarten 
Entering 1st 
Non-3ntering 1st 
2nd 
3rdf 


+ + + 
- - + 


+ + -♦- 
- 4* -t- 

4- 


4- + 4- 
- + 4- 

4- 


-4-4- 

-4-4- 


Head Start 
equivalent 


Kindergarten 
Entering 1st 
Non-entering 1st 
2nd 
3rd 


^ - + 
+ + - 


- - 4- 
4- 


4- + - 
- - 4- 
4- + + 


- - 4- 

- + + 
+ 


- - 4- 

— 4-4- 
~ — 4~ 


Both Head 
Start and 
equivalent 


Kindergarten 
Entering 1st 
Non-entering 1st 
2nd 
3rd 


- ^ - 


- - 4- 


- - - 


- - 4- 
+ - - 
4-4-4- 


4- 

4 

4- 4- - 


No preschool 


Kindergarten 
Entering 1st 
Non-entering 1st 
2nd 
3rd 


+ + -f 

- - -f 
+ + - 

- - + 


4- 4- + 

4- 

4- - - 


+ + -r 
- - 4- 

4- 4- + 


- -h 4- 


4- 4- 4- 
- - 4- 


Total 


Kindergarten 
Entering 1st 
Non-entering 1st 
2nd • 

3rd 


+ + + 


4- 4- 4- 

- - 4- 

- - 4- 

- - 4- 


+ + + 
- - 4- 


-4-4- 

4- 

4- 


4- 4- 4- 

- - 4- 

- - 4- 


* Sign Fall 


(Left-hand) Spring (Middle) [Spring] 


-iFall] 


(Right-hand) 





4- 


FT > 

Pre 


NFT 

Pre 


FT > 

Post 


NFT 

Post 


FT, 

(Post-Pre) 


> NFT, 

(Post-Pre) 


- 


FT < 

Pre 


NFT^ 

Pre 


FT^ < 

Post 


NFT 

Post 


FT 

(Post-Pre) 


< NFT, 

(Fost-Pre) 



i" Poverty classification not possible at third grade since interviews not 
conducted to obtain family income and family size information. 
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(3) The overall pattern for non-entering first graders was 
identical to that for entering first graders (--+). 

(4) The second grade non- Follow Through pupils exceeded 
Follow Through in the Fall, exceeded them in the Spring 
and gained more between Fall to Spring. This pattern is 



that f tr ° in Table 17 may be read in a manner similar to 

that for the overall total. When Table 17 is examined in parallel with 
its associated data tables in Appendix A (Tables A-71 through A-74 ) 
the following generalizations emerge: ’ 



(1) Differences favoring Follow Through occurred more often 
ut the entering grade levels (kindergarten and entering 

irst grade) than at the higher grade levels. This gen- 
eralization holds for both the Follow Through vs non- 
Follow Through difference on the Spring measure and for 
the Follow Through vs non-Follow Through difference in 
to-Spring change. 

(2) At entering grade levels, positive differences favoring 
Follow Through were more likely to occur among children 
classified as Certain poverty and Possible poverty than 
among children classified as Not poverty. At non- 
entering grade levels, the picture is less clear; if 
anything, differences favoring Follow Through (or the 
smallest differences favoring non-Follow Through) are 
somewhat more likely to occur among less poor than more 
poor children. 

(3) At entering grade levels, children who had experienced 

Head Start and children who had had no preschool whatso- 
ever were mo o likely to show differences favoring Follow 
Through than were children who experienced a progi'am 
classified as "equivalent” to Head Start. At non-eutering 
grade levels, however, some advantage seems to follow from 
havxng participated in a program classified as equivalent 
to Head Start rather than in Head Start itself. Never- 
theless, for all grade levels combined, the trend is rea- 
sonably clear--Follow Through children who experienced 
Head Start scored better on the achievement battery than 
did non-Follow Through children who had experienced Head 
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Table 18 shows interactions between poverty classification and 
Follow Through services as they influence the achievement test scores. 
This table may be read in a manner identical to the preceding table. 

Table 18 shows patterns that are in harmony with those discussed in the 
preceding table. Generally, the effects most favorable to Follow Through 
occurred in the entering grade levels. Greatest gains overall were shown 

by children who received all Follow Through services rather than part of 
them. ^ 

The final table in this set of three--Table 19— summarizes the in- 
teractions between preschool experience and Follow Through services over 
all grade levels as they influence performance on the achievement tests."^ 
In this table it is possible to include third grade in addition to lower 

grades. The patterns revealed in Table 19 support the findings discussed 
above : 

(1) Differences favoring Follow Through are more prominent in the 
lower grades than in the higher grades. 

(2) Gain differences favoring Follow Through were more likely 
when children received full Follow Through services than 
when they received less than full services. 

These three tables, supplemented by the 13 tables in Appendix A 
presenting achievement data, support the generalization that Follow 
Through’s polxcy goals are being realized, particularly among entering 
grade level children who constitute the first group to have experienced 
acceptably implemented programs. Particularly when effects are expressed 
as achievement test score gains from Fall to Spring, the children who 
apparently received the greatest advantages from Follow Through partici- 
pation were those who (l) were eligible for Follow Through on the poverty 
criterion, (2) had experienced Head Start or comparable programs prior 

to entry into Follow Through, and (s ) were receiving all services rather 
than partial services. 



Interaction s Associated With Attitude s Towart School 



The same combinations of policy variables (poverty level, preschool 
experience, and amount of Follow Through services) were examined with 
reference to the outcome measure of attitudes toward school. These data* 
are summarized in sign (+ or -) form and are supplemented by tables in 
Appendix A. The meaning of the signs is similar to that in the preceding 
set of tables, with one critical difference-- in Tables 20 through 22 a 



* See Tables A-75 through A-78 in Appendix A. 
t See Tables A-79 through A-83 in Appendix A. 
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Table 18 



DIRECTION OF DIFFERENCES BETWEEN FOLLOW THROUGH AND NON-FOLLOW THROUGH 
PUPILS AT ALL GRADES ON ACHIEVEMENT TEST SCORES OBTAINED FALL 
AND SPRING, 1969-70, BV POVERTY CLASSIFICATION 
AND FOLLOW THROUGH SERVICES RECEIVED* 



Poverty 

Classification 

Certain 

poverty 



1969-70 
School Grade 



Kindergarten 
Entering 1st 
Non-entering 1st 
2nd 
3rdt 



Follow Through 
All Part 



+ + + - 4 + 

- - 4- + + + 

- - - + + + 



Serv ices 
Unknown Total 

+ + + + 4- + 

4- - - 4- 



Possible 

poverty 



Not poverty 



Poverty not 
known (no 
interview 
conducted) 



Kindergarten 




4- 


4- 


4- 


- 


- 


- 


4- 


4- 


- 


4- 


4- 


4- 


Entering 1st 




- 


- 


4- 


4- 


4- 


- 








- 




4- 


Non-entering 


1st 


- 


- 


4- 


4- 


4- 


4- 


- 


- 


4- 


- 


- 


4- 


2nd 




- 


- 


4- 


4- 


4- 


4- 








— 


- 


4- 


3rd 




























Kindergarten 




- 


— 


4- 


4- 


4- 


_ 


4- 


4- 




4- 


4- 


4- 


Entering 1st 




- 


- 


4- 


- 


- 


4- 


- 


- 


4- 




- 


4- 


Non-entering 


1st 


- 


- 


- 


4- 


4- 


4- 


_ 


_ 






— 




2nd 




- 


- 


4- 


4- 


- 


- 














3rd 




























Kindergarten 




- 


- 


4- 


4- 


_ 


_ 


4- 


4- 


4- 





4- 


4- 


Entering 1st 




- 


- 


4- 


4- 


4- 


- 


4- 


4- 


- 


— 


- 


4- 


Non -entering 


1st 


- 


- 


4- 


- 


- 


- 


- 


- 


4- 


- 


- 


4- 


2nd 




- 


- 


- 


4- 


4- 


- 


— 


- 


- 




— 




3rd 





























Total 



Kindergarten -4-4- 4-4-- 

Entering 1st 

Non-entering 1st - ^ ^ ^ ^ 

2nd ^ ^ _ -I- + „ 

3rd 



4 - 4 - 4 - 4 - 4 - 4 - 

4- - - 4 - 



* Fall (Left-hand) Spring (Middle) [Spring]- [Fall] (Right-hand) 



4- 


FT^ > 

Pre 


NFT 

Pre 


FT > 

Post 


NFr 

Post 


FT, 

(Post-Pre) 


> NFT, 

(Post-Pre) 


- 


FT < 

Pre 


NFT 

Pre 


FT < 

Post 


NFT 

Post 


FT 

(Post-Pre) 


< NFT, 

(Post-Pre) 



t Poverty classification not possible at third grade since interviews 
not conducted to obtain family income and family size information. 
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Table 19 



DIRECTION OF DIFFERENCES BETWEEN FOLLOW THROUGH AND NON -FOLLOW THROUGH 
PUPILS AT ALL GRADES ON ACHIEVEMENT TEST SCORES OBTAINED FALL 
AND SPRING, 1969-70, BY PRESCHOOL EXPERIENCE AND 
FOLLOW THROUGH SERVICES RECEIVED* 



Preschool 

Experience 


1969-70 
School Grade 


Foil ow 
All 


Through 

Part 


Serv ices 
Unknown 


Total 


Head Start 


K inderjjar ten 




-h + 


- - 4“ 


4-4-4- 


-4-4- 




Entering 1st 


- 


- -4- 


4“ 4“ 4- 


4-4-4- 


-4-4- 




Non— entering 1st 


- 


- - 


- - - 


- - 4- 


— _ ^ 




2nd 


- 


- + 


4- 4- - 


- - 4- 






3rd 


- 


- - 


H 


4 - - 


H 


Head Start 


Kindergarten 


— 


- + 


4- 4- - 


4- 4- 4- 


„ _ 


equivalent 


Entering 1st 


- 


- + 


- 4- 4- 


-- - - 


- - 4- 




Npn -entering 1st 


- 


+ -h 


4-4-4- 


- 4- 4- 


- 4- 4- 




2nd 


- 


- + 


4- - - 


_ _ - 


- - 4- 




3rd 


- 


-h -h 


- 4- 4- 


- - - 


- 4- 4- 


Both Head 


K inder gar ten 












Start and 


Entex-ing 1st 


- 


- + 


- - 4- 




— — -1- 


equivalent 


Non-entering 1st 


-4- 


_ _ 


- — 


- — — 


H 




2nd 


-4“ 


-4 




_ - — 


4- H 




3rd 












No pre school. 


Kindergarten 


- 


4* -4“ 


+ H 


4- 4- - 


+ 4- -|- 




Entering 1st 


- 


- -4- 


4- 4- - 


- - - 


- - 4- 




Non --entering 1st 


- 


- - 


4- 4- - 


_ ~ - 


— — _ 




2nd 


- 


- - 


4- H 


- - - 


— — - 




3rd 


- 


- - 


4- 4- - 


4- H 


- - - 


Total 


K inder gar ten 


— 


4- 4- 


4- 4- - 


4-4-4- 


4 4-4- 




Entering 1st 


- 


- 4- 


4- 4- - 


H 


- - 4- 




Non-entering 1st 


- 


- 4- 


4- H 


- - - 


- - 4- 




2nd 


- 


- ^ 


-f H 


“ — " 


— ^ _ 




3rd 


- 


- - 


4- H 


4- - - 


H 



Fall (Left-hand) Spring (Middle) [Spring]-[Fall.1 (Right-hand) 



4- 


FT > 

Pre 


NFT 

Pre 


FT > 

Post 


NFT 

Post 


FT > NFT 

(Post-Pre) (Post-Pre) 


— 


FT < 

Pre 


NFT 

Pre 


FT^ < 

Post 


NFT 

Post 


FT ^ . < NFT 

(Post-Pre) (Post-Pre) 
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sign in the tab le denotes a desirable dif ference from the vi - 
of Follow Through . (Attitude scales were scored in such a way that 
the lowest score was associated with the most positive attitude.) 

The overall findings on attitudes toward school are neither as 
clear nor as readily interpreted as the findings on measures of school 
achievement. Overall, as summarized in the lower righthand cells of 
Tables 20, 21, and 22, Follow Through pupils at kindergarten, enter- 
ing first, non-entering first, and second grade shower! more shift to 
more positive attitudes toward school than did their non-Follow Through 
counterparts. This did not obtain at grade three. Children at kinder- 
garten and second grade reflected more positive attitudes toward school 
than did their non-Follow Through companions on the Spring measure but 

this was not true for children at entering first, non-entering first 
and third grade . ’ 



The magnitude of the differences shown by signs in Table 20, 21, 
and 22, and supported quantitatively in Appendix Table A-84 through 
A-96, are not large enough to permit a confident conclusion that Follow 
Through and non-Follow Through children differ in their attitudes toward 
school. At the entering grade levels, the data suggest more positive 
attitudes by Follow Through than non-Follow Through pupils among those 
who are classified as most poor. The reverse is suggested v.’hen the 
least poor children are contrasted. Over all grade levels (except thirk) 
the greatest shifts toward more positive attitudes occurred among chil- 
dren who received ail Follow Through services. There is some indication 
that children who experienced Head Start or a comparable preschool pro- 
^ gram were more likely to show the largest shifts to more positive atti- 
tudes toward school. Generally, however^; the erratic character of the 
findings according to any of the three variables or combinations among 
them is consistent with the overall lack of reliable difference between 

Follow Through and non-Follow Through on the measure of attitudes toward 
school o 



Interactions Associated With Interpersonal Feelings 



The outcome measure of interpersonal feelings is summarized in 
Tables 23, 24, and 25 in relation to the policy variables of poverty 

classification, preschool experience, and Follow Through services. As 
was the case in the measures of attitudes toward school, a negative sign 
in the table denotes more positive interpersonal feelings for Follow 
Through children than for non-Follow Through children. Tables A-97 

through A-109 in Appendix A provide quantitative detail in support of 
the sign tables. 
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Table 20 



direction of differences between follow THRoiiph axrr, 

y 70^ BY preschool EXPERIENCE AND 

POVERTY CLASSIFICATION* 



Preschool 


1969-70 
School Grade 




Poverty Classification 






Experience 


Certain 

Poverty 


Possible 


Not 






Head Start 


Kindez'gar ten 
Entering 1st 
Non-entering 1st 
2nd 
3rdt 


+ 


Pover ty 

+ -f — 

+ - - 
+ + - 
'*’ + -f 


Poverty 

- -f -f. 


Unknown 
+ d- 


Total 

. 

- - 



Head Start 
equivalent 



Both }iead 
Staz't and 
equivalent 



No preschool 



Total 



Kindergaz’ten 
Entering 1st 
Non-Entering 1st 
2nd 
3rd 

Kindergarten 
Entering 1st 
Non-Entering 1st 
2nd 
3rd 

Kindergarten 
Entering 1st 
Non-entering 1st 

2nd 

3rd 

Kindergaz'ten 
Enteriiig is t 
Non-entering 1st 
2nd 
3rd 



-h - - 
+ + - 

+ + — 



+ + 



H 

+ -f - 

- f -f 



+ — — 
- - -H 



+ FT > nFT 
Pre 

ft < NFT 
Pre Pre 



FT > NFT 

Post I 

FT . < NFT 
Post p 



+ + 


“ "f + 


+ — — 


-E - - 


+ + - 


-f -E 


-E - - 


^- -E - 


+ - - 


. — "E -E 

~E — ^ 


+ - ^ 

+ + + 


+ - - 

+ + - 






“ -E 


- + -E 


- -E -E 


-E - 


- 






"E. + “E 


-E -E - 




■E "E 'E 


+ -E 


H- -E -E 




-E - - 


~E ”E + 


•+ “f 


+ + + 


■^, -E - 


. - - - 


-E - - 




-f -E ^- 


H- -E +. 


“E — — 


— — 


+ -E + 




'E + - 




- - - 


-E + - 


-E -E - 








. [Spring]-[Fall] (Rip-ht 




FT 

(Pos t- 


-Pre) > NFT 


i.'Post-Pre) 




FT, 

(Post- 


Pre) < NFT 


(Post-Pre) 





not possible at ^ 

Note: Lower scoi’s on a 1 - 1 - i i-,, 

'school and learning; neg” tivniSren^T-)^ Positive attitude toward 
Through perspective, ®srrable from Follow 
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Table 21 



^ 1969-70, BY POVERTY CLASSIFICATION 
AND FOLLOW THROUGH SERVICES RECEIVED* 



Poverty 

Classification 

Certain 

poverty 



Possible 

poverty 



1969-70 
School Grade 



Follow Through Services 
_Ail_ Part Unknown Total 



Kindergarten „ _ _ 
Entering 1st + - - 
Non-entering 1st - - h- 
2nd _ ^ ^ 
3rdt 

Kindergarten H- H- - 
Entering 1st H- - - 
Non-entering 1st H- - - 
2nd _ + ^ 
3rd 



H- - - 
^- - - 
- - ^- 
- H- H- 



H- H- - 

^- - - 
- - H- 



H- - - 
^- - - 



H- - - 



-h - - 
“* — , 4- 
- - + 



H- - - 

H- - - 
- H- H- 



Not poverty Kindergarten _ + + 

Entering 1st H- H- 

Non -entering 1 st - - - 

2nd _ 

3rd 



+ H- H- 
- H- H- 
H- - - 



H- H- - 
- H- H- 
+ H- H- 



H- H- 
H- H- 

H- - - 



Poverty not 
known (no 
interview 
conducted) 



Kindergarten. , H- H- h- 
Entering 1st 4- - - 

Non-entering 1 st h- -f - 

2nd 

3rd 



4- 4- ^- 

- 4 - 4 - 

“ - 4- 



4- 4- - 
4- 4- - 
4- 4- 
- - 4- 



4- - - 
4- 4- - 



Total 



. Kindergarten 4- « 

Entering 1st _ 

Non-entering 1st 4- 4- - 
2nd 
3rd 



4- - -. 
- 4- 4- 



4- - - 

- - 4- 
4- 4- - 

- - 4- 



4- 4- - 
4- 4- - 



Si^ £ali_(i^^ sprlngjj^^ 



H- FT > NFT 

Pre Pre 



FT 



Pre 



NFT 



FT ^ NFT 

Post Post (Post-Pre) > 



Pre 



FT < NFT 

Post Pos ‘ 



'^(Po.t-Pro) ■= “"-(Po.t-p, 



ver y classification not possible a t th ir*H h 
not to ootatn 

ingj, negative dif ferencr^^ ^ \ ^ 

from Follow Through perspective. i^erence (-) desirable 
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Table 22 



DIFFEREKCES BET»EEN FOLLO» through A„l NON-FOLLOW TimoUOH 
PUPILS AT ALL GRADES ON ATTITUDES TOWARD SCHOOL SCORES OBTAINED 
FALL AND SPRING, 1969-70, BY PRESCHOOL EXPERIENCE AND 
FOLLOW THROUGH SERVICES RECEIVED* 



Preschool 

Experience 

Head Start 



Head Start 
equivalent 



Both Head 
Start and 
equivalent 



No preschool 



Total 



1969-70 
Schoo 1 Gz" ade 



Follow Through Servicos 

^ ^ Unknown Total 



Kindergarten - + ^ 

Entering 1 st + ^ _ 

Non -entering l&t - + + 
2 nd - _ _ 

3rd + + + 

Kindergarten + -f. - 

Entering 1st + + - 

Non-entering 1 st 4- + - 

+ + — 

- *f + 



2 nd 

3rd 



•f - - 
*f - - 

- - 

^- - - 
- - + 
+ + + 



+ 



- + ^- 

- - 

+ - - 
+ + — 



+ 

— -f- 'h 

+ + — 
+ + — 



Kindergarten 
Entering 1 st +++ 

Non -entering 1 st - _ _ 

isiid _ _ _ 

3rd 

Kindergarten -f + >|_ 

Entering 1 st + + + 

Non-entering 1 st + + - 

2 nd ■ ^ _ 

3rd ^ - - -f 

Kindergarten + _ 

Entering 1 st -f 

Non-entering 1 st + H 

2 nd 

3rd ^ ^ 









' + + 





*“ *E ^- 


■ + + 


— + + 


- ^ - 






- - 


— 


+ + - 


+ + — 


+ + 


— + + 


*f‘ + + 


-f + 


+ + — 


+ + — 


- 


^ ^ _ 


•F - - 


+ 


— -F -F 


+ 


- - 




.+ - - 


- - 




-j- 4- — 




+ 4 - - 


+ 4- - 


- - 


- - + 


- - - 


4- + 


- + t 


— 4- 4_ 


[Sp 


ring]-[Fal 


1 ] (Uii 



+ FT > NFT FT > MFT t?'t 

Post > "’^po.t '^<P„at-Pr.) > "'^(Pos.-PFa: 

FT < NFT FT <: wpt 

P- Pre post --Post ^CPost-P.e) < ^^(Post-Pre; 

Note: Lower score on attitude measure denotes more positive attitude 

o«ard school and learning; negative difference (-) desirable 
from Follow Through perspective. 
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The overall differences shown in Tables 23, 24, and 25, are not 
statistically significant. As a whole, Follow Through pupils show 
slightly less positive interpersonal feelings toward classmates and 
teachers than do non-Follow Through pupils but the difference is not 
significant. Follow Through pupils at grade levels beyond kindergarten 
are somewhat more likely to have shown larger shifts toward more positive 
feelings than non-Follow Through but, again, the difference is not sig- 
There is some tendency for Follow Through pupils at all grade 
levels classified as Certain poverty to show both more positive inter- 
personal feelings and larger shifts to more positive interpersonal feel- 
ings than for children in other poverty classifications. 

The picture is even less clear when the preschool expCi" . • :e vari- 
able is considered. What shows as a more favorable pattern for children 
with such experience at the entering grade levels is a less favorable 
pattern for children at non-entering grade levels. 

The differences most likely to favor Follow Through according to 
the Follow Through services variable occur among children who receive 
partial rather than all services; this trend is more evident among enter- 
ing grade level children than among children at higher grade levels. 

In summary: slightly more positive interpersonal feelings are re- 

flected by Follow Through children at higher grade levels than at lower 
grade levels. On the other hand, children at lower grade levels are more 
likely to show a shift toward more positive interpersonal feelings. The 
safest conclusion that seems warranted is that the differences between 

and non-Follow Thi’cngh children on the measure, rega,rdless 
of levex of poverty, preschool experience, or extent of Follow Through 
services, are too capricious to be considered statistically significant. 
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Table 23 



DIRECTION OF DIFFERENCES BETWEEN FOLLOW THROUGH AND NON -FOLLOW THROUGH 
PUPILS AT ALL GRADES ON INTERPERSONAL FEELINGS SCORES OBTAINED 
FALL AND SPRING, 1969-70, BY PRESCHOOL EXPERIENCE AND 
POVERTY classification’^ 



Poverty Classification 



Preschool 


1969-70 


Certain 


Possible 


Not 






Exper ience 


School Grade 


Poverty 


Poverty 


Poverty 


Unknown 


Total 


Head Start 


Kindergarten 




+ + 


+ 


-4-4- 


' - 4- 




Entering 1st 


-f -f - 






4- - - 


4- 4- 4 - 




Non -entering 1st 


- - - 


+ + + 


+ - - 


-4-4- 


4-4-4- 




2nd 


- - - 












3rdt 












Head Start 


Kindergarten 


H 




+ 4- + 


4 


4- 4- ~ 


equivalent 


Entering 1st 


+ + - 


+ + 


+ 4- - 


4- 4- - 


4- 4- - 




Non-entering 1st 


+ - - 




-4-4- 


4- 4- 4- 


4 - 4 - 4 - 




2nd 






4- 


4-4-4- 


4- 4- ~ 




3rd 












Both Head 


Kindergarten 












Start and 


Entering 1st 








4 . 4- ^ 


4- 4- - 


equivalent 


Non-entering 1st 


- - - 


- - - 


w ^ . 


4- 4- - 







2nd 








- 4- 4- 


4- 




3rd 












No preschool 


Kindergarten 


+ - - 




- - 4 - 4- 


4-4-4- 


4- 4- - 




Entering 1st 


+ + + 


+ + + 


4- .4- 4- 


4- 


4- 4- - 




Non-entering 1st 




- - - 


4- 4- 4- 


4- 4- - 


4- 4- - 




2nd 





+ + - 


-4-4- 


■i- — — 


4- - - 




3rd 












Total 


Kindergarten 




+ + - 


4-4-4- 


4-4-4- 


4-4-4- 




Entering 1st 


-1- H 


- + + 


4- 4- - 


4 


4- 4- - 




Non-entering 1st 


-f 


H 


4- 4- - 


4 — - 


4- 4- - 




2nd 


- ^ 


+ + + 


4- - - 


4- 


4- - - 




3rd 















Sign 


Fall 


(Left-hand) 


Spring (Middle) 


[Spring]-[Fall] 


(jlight-hand) 




4- 


FT 

Pre 


> NFT 

Pre 


FT ^ > NFT 

Post Post 


FT^ > 

(Post-Pre) 


NFT, 

(Post-Pre) 




— 


FT 

Pre 


< NFT 

Pre 


FT < NFT 

Post Post 


FT^ 

(Post-Pre) 


NFT, 

(Post-Pre) 


t 


Poverty classification 


not possible at third grade since 


interviews 



not conducted to obtain family income and family size information 



Note: Lower score on attitude measure denotes more positive interpersonal 

feelings; negative difference (-) desirable from Follow Through 
perspective. 
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Table 24 



T.-= 



■»• Ly 

Classif ication 

Certain 

poverty 






c* H A nrough 

.School Grade ah ~d — ; ~ 



Possible 

poverty 



Not poverty 



Poverty not 
known (no 
interview 
conducted) 



Kindergarten _ __ 

Entering 1st + + - 

Non-entering 1st -I — _ 
2nd 

3 rdt 

Kindergarten + 4. ^ 

Entering 1st - + + 

Non-entering 1st + 

+ + + 



PaiV thThnown Total 



2nd 

3 rd 



4 - - ^ 






~ + 
+ + 
+ 
- 4 - 



Kindergarten 
Entering 1 st 
Non-entering 1st 

2 nd 

3 rd 

Kindergarten 
Entering 1st 
Non-entering 1st 
2nd 
3 rd 



+ 4-4- 

+ + + + + - 

+ + - - 4 - 4 - 

+ + - 



+ + 4 - 4 - - 

+ + + 4- 4 - - 



+ 



+ 



+ - 
+ + 
+ + 









+ + - 
+ 4- 



+ + + 

+ + - 
+ 



+ ~ 
+ + 
4- - 



+ + - 

- + + 

+ + + 



+ + + 
+ + - 
+ + - 
+ 



+ + + 

+ + - 
+ 



Total 



Kindergarten -f 4- ^ _ _ 

Entering 1st + 4- - 4- ~ I 

Non-entering 1st + + - +4. 

2 nd , -T- -r - 

3 rd +---- + 



+ + - 

+ 

+ + + 



+ + + 
+ + - 
+ + - 
+ 



• so, oaa™. 
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t Poverty classi-fsr' i- • (Posi:-ppe) 
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Table 25 



DIRECTION OF DIFFERENCES BETWEEN FOLLOW THROUGH AND NON -FOLLOW THROUGH 
PUPILS AT ALL CHADLS O.T lUTLRPEBSOUAL FEELINOS SCORES 

PALL AND SPRING, 1969-70, BY PRESCHOOL EXPERIt.VCE AND 
FOLLOW THROUGH SERIVICES RECEIVED* 



Preschool 

Experience 



1969-70 
School Gi-ade 



Follow Through Services 
- All Part Unknown 



Heaa Start 


K i! -de ten 


- - 4- 






4- 


4- - ^ 




E nter xng^ 3 s t 


4- 4- 4- 




— 




4- 4- - 




Non-entering 1st 
2nd 


4-4-4- 


- 


4- 


4- 

4- 


4- 4- 

- -- 




3rd 


4-4-4- 


- 


4- 


4- 


- 4- 4- 


Head Start 


Kindergarten 


E 4- - 


4- 






~ 4- 4- 
4- 4- - 


equivalent 


Entering 1st 


4- 4- - 


4- 


-f- 


>» 




Non-entering 1 st 


4-4-4- 


- 


4- 


4- 






2ud 


4- 4- - 


— 


4- 


4- 


- - 4- 


Both Head 


3rd 

K indergar ten 


4- - - 


4- 


— 


— 




Start and 


Entering 1st 


4- 4- - 


-1- 


4- 






equivalent 


Non-entering 1 st 

2nd 

3rd 


4- 


4- 




- 


- 4- 4- 

- -- 4- 



No preschool 



Total 



Tot 



+ -I- + 
4- 4- 

-4-4- 

4- 4- - 

4- 4- ^ 

4-4-4- 
4- 4- - 
4- 



4- 4- 



4- 



Kindergarten 


4- 


4- 


4- 


- 


- 




4- 


4- 




4- 


4- 




Entering 1st 


4- 


4- 


4- 


4- 


- 


- 


_ 


4- 


4- 


-f 


-f 




Non-entering 1 st 


4- 


4- 


- 


4- 


4- 




4- 


4- 


4- 


4- 


-f 




2nd 


4- 


- 


- 


- 


- 


4- 


4- 


4- 




4- 






3rd 


- 


4- 


4- 


- 


- 


- 


4- 




... 




- 


4- 


Kindergarten 


4- 


4- 


4- 


_ 







4- 


4- 




' 4- 


4- 


-f 


Entering 1st 


4- 


4- 


- 


4- 


- 


- 


_ 




4- 


4- 


4- 




lion-entoring 1 st 


4- 


4- 


- 


4- 


4- 


— 


4- 


4- 


4 


-f 


-f 




2nd 


4- 


- 


- 


- 




4- 








-f 






3rd 


4- 


4- 


4- 


- 


4- 


4- 


- 


4- 


4- 




4- 


4- 



Sign F^lj_ aeft-hancl _ ) Spring (Middle) _ [Spring] - [Falll 

> NFT 

r 

< NFT 



4- 


FT 

Pre 


NFT 

Pre 


FT 

Post 


- 


FT < 

Pre 


NFT 

Pre 


FT 

Post 



‘Post ^"^(Post-Pre) ^ 



(Post-Pre) 



Post ^"^(Post-Pre) ^ NFT. 



(Post-Pre) 

Note, Lowof .core o„ attitude n.oa.ure d.uote. „„„ po.itiv. lat.rper.on.l 
per.;;«L”"'"” <-) desireuie Ire, Polio. ThrousD 
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The OutcoTie Measures , by Poverty Classificat ion 
and Sponsor Group 



In the following pages, figures are used to display pupil performance 
on the achievement test battery, the attitudes toward school scale, and 
the interpersonal feelings scale. Kindergartners are shown first, fol- 
lowed by entering first graders, non-entering first graders, and second 
graders. 

The upper (line) graph in each figure contrasts Follow Through and 
■non 'Follow Through children at both Fall and Spi’:^ ' points according to 
their poverty classification. All children for w . test data were avail- 
able are reflectesi in these graphs; children whose parents were not inter- 
viewed, and therefore cannot be included in one of the three poverty 
classifications, are included in the category ”No Income Information.” 

The lower (bar) graph in each figure contrasts the performance of 
the same Follow Through and non -Follow Through children in all poverty 
categories according to sponsor group (see Section III). 

For each pair of graphs that follow, a set of supporting tables ap- 
pears in Appendix A in the same sequence as the figures. The tables in- 
clude some key information not reflected in the figures: 

(1) The total number of children in each poverty classification 
and the number on whom scores were available. 

( 2 ) The means and standard deviations for both the Follow Through 
and non -Follow through distributions according to poverty 
level. 

( 3 ) The mean difference and the standard error of the mean dif- 
ference between Follow Through and non-Follow Through in each 
poverty stratum. 

( 4 ) The t-r?.tio associated with each mean difference. 

( 5 ) The pove-'ty classifications within each sponsor group as well 
as the poverty classifications for children at each grade 
level. 



Supporting tables in Appendix A are arranged as follows: kindergarten 

(A~5 through A-22) , entering first grade (A-23 through A-37) , non-entering 
first grade (A-38 through A-55) , and second grade (A-56 through A-70) . 
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Kindergarten 



Achievement Test Performance — The graphs in Figure 1 show Fo7.1ow 
Through pupils exceeding non-Follow Through pupils in achievement test 
performance both in the Fall r.md in the Spring. The two groups were 
virtually identical in the Fail in their mean scores but the difference 
between them was statistically significant and favored Follow Through 
(p < . 02 ) in the Spiing, The difiex'ence in the Pall— to— Spring gains be- 
tween X-ollow Through and non-Follow Through kindergartners favored Follow 
Through and was clearly significant (p < .005). 

The upper grap'i in the figure shows the characteristic positive 
correlation between measured achievement and poverty level. The most 
notable feature of chis relationship is the fact that the largest dif- 
ference between Follow Through and non-Follow Through in Fall-to-Spring 
gains occurred among children classified as Certain poverty. That dif- 
ference, in fact, dominates the overall difference between Follow "Fhrough 
and aon-Follow Through and was highly significant (p < .002). 

The lower graph in the figure shows different patterns for each of 
the five sponsor groups represented at the kindergarten level. In Sponsor 
Group 1, Follow Through children began the year at a level below their 
non-Follow Through counterparts and ended the year with higher mean 
achievement scores. The difference between Follow Through and non-Follow 
Through at the Spring point was large enough to be significant (p < .05). 
Because Follow Through children gained substantially more during the year, 
the difference in gain was highly significant overall (p < .001); the 
largest relative difference occurred among children classified as Cr ain 
poverty (p < .001) but the difference among children categorized a 
Possible poverty v/as also reliable (p < .05). 

In some contrast to Sponsor Group 1, the children in Sponsor Group 2 
began the school year at a lower level than their non-Follow Through com- 
parisons and completet' the year at a similar rel; :ive position. The dif- 
ferences between the two groups at the Fall test point approached statis- 
tical significance (p < .20) and was clearly significant at the Spring 
point (p < . 001 ). The difference in Fall-to-Spring gains between Follow 
Through and non-Follc.v Through children was marginally significant over- 
all (p =“ .10) bwt was not statistically significant at any single poverty 
level. 



Sponsor Group 3 displayed an achievement test pattern that was 
virtually the revej-se of that demonstrated in Sponsor Group 2— the Follow 
Through children began the year ahead of their non-Follow Through com- 
parisons and finished the year at a higher mean level. At neither the 
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PUPIL ACHIEVEMENT SCORES 
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SPONSOR GROUP 



FIGURE 1 



MEAN STANDARDIZED PUPIL ACHIEVEMENT SCORES FOR FOLLOW THROUGH (FT) 
AND NON-FOLLOW THROUGH (NFT) KINDERGARTNERS IN 18 PROJECTS 
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Fall nor Spring points, however, were the overall differences between 
Follow Through and non-Follow Through children statistically significant. 
Among children classified as not poor, however, the difference in gains 
between the Follow Through and non-Follow Through groups favored Follow 
Through and was statistically significant (p < .01). 

The largest differences between Follow Through and non-Follow Through 
children were reflected in the performance of pupils in Sponsor Group 4. 
Their achievement test scores were significantly higher than non-Follow 
Through at the beginning of the year (p < .001). This difference was 
even gx'eater at the Spring measurement point, which meant that the dif- 
ference betv'cen Follow Through and non-Follow Through children in Fall— 
to-Spring icnins was also statistically significant (p < .002). The 
subgroup that showed the greatest gains from Fall to Spring in Sponsor 
Gi'oup 4 were children classified as Ce ‘■?.in poverty (p < .05). 

Sponsor Group 5 was represented in the kindergarten data by only 
one project; the total number of children whose scores are reflected in 
the bar graphs in Figure 1 is less than 100. Despite this small number, 
the difference in achievement score means at the Fall point was statis- 
tically significant favoring non-Follow Through (p < .002). As the graph 
shows , however , Follow Through children in Sponsor Gi‘oup 5 displayed sub- 
stantially greater gains between the Fall and Spri.ig points and this 
difference was highly significant (p < .001). 

Attitudes Toward School — ^Although non-Follow Through children as 
a whole showed slightly more favorable attitudes toward school on the 
Fall measure (see Figure 2 ), tho difference between them and Follow 
Through pupils was not significant. The two groups were virtually iden- 
tical in bhe Sprinp;. Follow Through children showed a greater shift than 
non-Follow Through to more positive attitudes toward school but the dif- 
ference between groups in the changes were not statistically reliable. 

Desirable attitudes toward school are correlated with poverty level. 
In the line graph, this relationship shows as a down slope but, it will 
be recalled, the scoring of the attitude scales was such that a lower 
score denoted more positive attitude. The line graph does show rather 
clearly that the greatest shifts lo more favorabj.3 attitudes toward 
school were shown by chi jn who were Certain poverty; this was true 
for both Follow Through and non-Follow Through children. 

The bar graph displaying differences among sponsor groups appears 
in the bottom half of Figure 2. No significant differences were indi- 
cated between Pol.low Through and non-Follow Through children for Sponsor 
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ATTITUDES TOWARD SCHOOL ATTITUDES TOWARD SCHOOL 




POVERTY CLASSIFICATION 



60 



55 




HI Spring 




SPONSOR GROUP 

FIGURE 2 MEAN STANDARDIZED ATTITUDES TOWARD SCHOOL SCORES FOR FOLLOW 
THROUGH (J=T) AND NON-FOLLOW THROUGH (NFT) KINDERGARTNERS IN 
18 PROJECTS 








Groups 1, 2, or 5. in Sponsor Group 3, both Fall and Spring measures 
showed non— Follow Through children reporting more positive attitudes 
toward school/^ The difference at the Fall point was statistically 
significant (p < .002) and was marginally significant (p < ,10) in the 
Spring. Follow Through children showed a greater shift toward more posi- 
tive attitudes but the difference between them and the non-Follow Through 
pupils was not significant. 

All the differences between Follow Through and non-Follow Through in 
Sponsor Group 4 favor Follow Through; more positive attitudes in the Fall 
(p < .05), more positive attitudes in the Spring (p < .001), and a greater 
shift toward more positive attitudes than non-Follow Through, In fact, 
as the bar graph shows, non-Follow Through children actually showed a 
change in the opposite direction. Despite this shift, the difference 
between Follow Through and non— Follow Through on their change scores was 
not statistically reliable. 



Interpersonal Feelings — The association between poverty level and 
interpersonal feelings scores followed the same general pattern as that 
shown for the measure of attitudes toward school. This trend is clear 
in the line graph at the top of Figure 3. When Follow Through and non- 
Follow Through children are compai'ed overall, however, none of the dif- 
ferences between Fall means. Spring means, or changes between Fall and 
Spring were statis tica3.1y significant. 

The sponsor groups are compared in the bar graph at the bottom of 
the figure. None of the contrasts between Follow Through and non-Follow 
Through for Sponsor Group 1 were significant. The initial scores for 
Sponsor Group 2 were not significantly different from one another but 
the Spring measure showed non-Follow Through children with somewhat more 
positive interpersonal feelings than Follow Through children (p < ,05). 

The Fall-to-Spring shifts, however, were not significantly different from 
one another. 

In Sponsor Group 3, the Fall scores showed non-Follow Through children 
with more positive interpersonal feelings than Follow Through (p < .02) 
but the comparison between Follow Through and non-Follow Through at the 
Spring point indicated that both groups were esse-ntially the same. The 
Follow Through children showed a greater shift toward rnoi'e positive feel- 
ijrgs but this difference was not statisticall 5 ' I'eliable. 



As in the earlier sign tables, the lower scores indicate more positive 
attitudes. 
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INTERPERSONAL FEELINGS INTERPERSONAL FEELINGS 
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NFT (Fall) 
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NFT (Spring) 



FT MEAN (Fall) 




NFT MEAN (Fall)- 



FT MEAN (Spring) 
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T 



CERTAIN 


POSSIBLE 
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NO INCOME 


POVERTY 


POVERTY 


POVERTY 


INFORMATION 




POVERTY 


CLASSIFICATION 




^ Fall m Spring 




3 , 4 5 OVERALL 

SPONSOR GROUP 



FIGURE 3 MEAN STANDARDIZED INTERPERSONAL FEELINGS SCORES FOR FOLLOW 
THROUGH (FT) AND NON-FOLLOW THROUGH (NFT) KINDERGARTNERS IN 
18 PROJECTS 
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In Sponsor Group 4, all of the comparisons favored Follow Through 
children but only the contrast between the two groups at the Spring point 
was reliable (p < .05). 

All the differences in Sponsor Group 5 favored non-Follow Through. 
From the bar graph it appears that the differences were substantial. 

Since only a small number of children were involved, however, only the 

difference between the two groups on the Spring measure is statistically 
significant (p < .002). 



Entering First Grade 

Achie vement Test Performance — The entering first grade children, 
along with the kindergartners , constitute the groups of greatest interest 

in the comparisons betv/een Follow Through and non-Follow Through during 
1969-70. 



The performance of entering first graders on the achievement test 
battery, as displayed in the graphs in Figure 4, showed a much different 
pattern than that displayed by the kindergartners whose performance was 
described above. Both the Fall and Spring comparisons between Follow 
Through and non-Follow Through children favored non-Follow Through and 
the magnitude of the difference was statistically significant at both 
times (p < .001 and p < .002, respectively). The Follow Through pupils, 
however, gained more between Fall and Spring than did the non-Follow 
Through children; this difference favoring Follow Through was statis- 
tically significant (p < .002). It was in the Certain poverty category 

that the largest difference favoring Follow Through occurred in the gains 
from Fall to Spring. 



The line graph at the top of Figure 4 shows the same positive 
correlation between poverty and school achievement as that reflected by 
kindergartners. Beyond that association, the most notable feature of 
the line graph is the initial wide difference between the Follow Through 
and non-Follow Through groups in all poverty categories. Difficulties 
in achieving ideal matches between Follow Through and non-Follow Through 
groups in the project locations from which these children came have been 
mentioned before. It is worth recalling that most of the school districts 
in the Follow Through experiment that do not have kindergartens as part 
of the regular school (i.e. , first grade is the entering year in Follow 
Through) are in the South. Of the nine projects represented in Figure 4 
seven are in the deep South , one in a mid-Atlantic state, and one in 
Appalachia. Only two of the nine would be considered urban. It was 
characteristic to experience difficulty in such locations in finding 
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PUPIL ACHIEVEMENT SCORES PUPIL ACHIEVEMENT SCORES 




POVERTY CLASSIFICATION 



60 




SPONSOR GROUP 



FIGURE 4 MEAN STANDARDIZED PUPIL ACHIEVEMENT SCORES FOR FOLLOW THROUGH (FT) 
AND NON-FOLLOW THROUGH (NFT) ENTERING FIRST GRADERS IN 9 PROJECTS 






^^on—Follow Thi’ough comparison schools and classes with similar socio- 
economic and ethnic characteristics. 

The bar graph in Figure 4 compares the performance of Follow Through 
and non-Follow Through children according to four sponsor groups. Each 
of the four displayed a different pattern cf contrast between Follow 
Through and non-Follow Through. In Sponsor Group 1 , the Follow Through 
children began the year at a level markedly below their non-Follow Through 
comparisons (p < .002). By Spring, however, these measured differences 
had disappeared. The Follow Through group gained substantially more than 
the non-Follow Through group (p < .001). 

The Follow Through children in Sponsor Group 2 began the 1969-70 
year somewhat ahead of the non-Follow Through children and increased 
this difference slightly. None of the differences (Fall, Spring, or 
gain) were statistically significant, however. In Sponsor Group 3, 

Follow Through children began and ended the year at levels considerably 
below the non-Follow Through children (p < .001 in both comparisons). 

The Follow Through children, however, gained significantly more between 
Fall and Spring (p < .01). 

The bar graph implies marked differences between Follow Through 
and non-Follow Through in Sponsor Group 4. Only a small number of chil- 
dren were included here, however, since this sponsor group is represented 
by only one project in the entering first grade. Thus, the differences, 
although apparently large in the graphic display, are not statistically 
significant. 



Attitudes Toward School — As was the case with kindergartners , enter- 
ing first graders also showed the characteristic correlation between at- 
titudes toward school and poverty; this is reflected in the down slopes 
from Certain poverty to Not poverty in the line graph of Figure 5 
Non-Follow Through children as a whole revealed somewhat more favorable 
attitudes toward school at the beginning of the year (p < .05) but the 
difference by Spring between the two groups was not significant. The 
overall difference between Follow Through and non-Follow Through in a 
shift toward more positive attitudes favored Follow Through but not sig- 
nificantly so. However, the Follow Through children classified as Certain 
poverty did show significantly greater positive shifts than non-Follow 
Through children in the same poverty classification (p < .05). 



As stated earlier, a lower score on the scale of attitude toward school 
means a better attitude, 
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ATTITUDES TOWARD SCHOOL ATTITUOES TOWARD SCHOOL 
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SPONSOR GROUP 



FIGURE 5 MEAN STANDARDIZED ATTITUDES TOWARD SCHOOL SCORES FOR FOLLOW 
THROUGH (FT) AND NON-FOLLOW THROUGH (NFT) ENTERING FIRST 
GRADERS IN 9 PROJECTS 
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As the bar graph in Figure 5 illustrates, Follow Through children 
in Sponsor Group 1 revealed less favorable attitudes toward school than 
did non-Follow Through children on both the Fall and Spring measures. 
Both these differences were statistically significant (p < .01 and p < 
.005). The shift toward more positive attitudes from Fall to Spring 
actually favored Follow Through slightly but the difference was not sig- 
nificant. In b th Sponsor Groups 2 and 3, none of the differences be- 
tween Follow Through and non-Follow Through on Fall, Spring, or gain 
measures were significant. 

In Sponsor Group 4, both the Fall and Spring measures showed Follow 
Through children with more positive attitudes toward school (p < .01 in 

both cases) but both groups showed essentially equal shifts between Fall 
and Spring. 



^ Feelings — The measure of interpersonal feelings, as 
a function of poverty level, demonstrated an association very similar to 
that displayed by the previous attitude measure, as indicated in the line 
graph at the top of Figure 6. As a whole, non-Follow Through children 
showed more positive (i.e., they had lower scores on the scale used) 
interpersonal feelings than Follow Through children on both the Fall and 
Spring measures; only the Fall difference, however, was clearly signifi- 
cant (p < .005). The difference between the two groups in the gains 
shown between Fall and Spring were not significant although they favored 
Follow Through. 



The differences between Follow Through and non-Follow Through accord- 
ing to sponsor groupings appear in the bar graph at the bottom of Fig- 
ure 6. The pattern over the first three sponsor groups was similar but 
not quite identical to that reflected in the attitudes toward school 
measure. All of the differences between Follow Through and non-Follow 
Through in Sponsor Group 1 favored non-Follow Through children. The 
difference in the Spring measure was significant (p < .005) and the dif- 
ference between the two groups in the Fa 11-to-Spring shift approached 
significance (p < .10). 



The positive changes of greatest magnitude favoring Follow Through 
were evinced by Sponsor Group 2. Although non-Follow Through children 
showed more positive interpersonal feelings in the Pall measure than did 
Follow Through, the relative positions were reversed in the Spring mea- 
sure; this difference favoring Follow Through in the Fall-to-Spring shift 
was reliable (p < .05). 
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FIGURE 6 



MEAN STANDARDIZED INTERPERSONAL FEELINGS SCORES FOR FOLLOW 
THROUGH (FT) AND NON-FOLLOW THROUGH (NFT) ENTERING FIRST 
GRADERS IN 9 PROJECTS i ms i 
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PUPIL ACHIEVEMENT SCORES PUPIL AdHIEVEliflEN" SCORES 
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FIGURE 7 MEAN STANDARDiZED PUPIL ACHIEVEMENT SCORES FOR FOLLOW THROUGH (FT) 
AND NON-FOLLOW THROUGH (NFT) NON-ENTERING FIRST graders IN 21 PR 
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FIGURE 10^: M ST^NpARDIZED^^ ACHIEVEMEKiT SCORES FOR FpELOW THROUGH (FT) 
AND NON-FOLLOW THROUGH (NFT) SECOND GRADERS IN 19 PROJECTS 







60 

Pall Spring 



55 




4 



OVERALL 



SPONSOR GROUP 



FIGURE 11 



O 

ERIC 



M E AN ST ANDAR D I ZED ATTITUDES TOWAR D SCHOOL SCORES FOR FO L LOW 
THROUGH (FT) AND NON-FOLLOIM THROUGH (NFT) SECOND GRADERS 
IN 19 PROJECTS 



126 





INTERPERSONAL FEELINGS INTERPERSONAL FEELINGS 




POVERTY CLASSIFICATION 



60 — 

IS '^all JH Spring 

55 







OVERALL 



FIGURE 12 MEAN standardized INTERPERSONAL FEELINGS SCORES FOR FOLLOW 
THROUGH (Rt): A^^^ THROUGH (NFT) SECOND GRADERS 

IN 19 PROJECTS 




127 




detailed tables in Appendix A from which one may obtain an indication 
of the statistical significance of any of the observed differences be- 
tween Follow Through and non-Follow Through. For these two reasons — 

(1) the lesser importance of children at these grade levels for the 
longitudinal evaluation and (2) the fact that detailed tables may be re- 
ferred to for questions regarding group sizes and the significance of 
differences — no detailed irrative description of these figures has been 
provided. 

Very briefly, the data at non-entering first grade on the achievement 
measure show that Fall and Spring scores favor non-Follow Through children 
at all poverty levels and in nearly all of the sponsor groups. Fall— to— 
Spring gains favor the Follow Through children significantly in Sponsor 
Group 1 (p < .005) , Sponsor Group 3 (p < .001, and Sponsor Group 5 (p < 
.05). In Sponsor Groups 2 and 4, however, the pattern is reversed and 
the differences favor non-Follow Through (p < .001 in both instances). 

The attitudes and interpersonal feelings measures at non-entering first 
grade in general show no differences of consequence between Follow Through 
and non-Follow Through. 

At the second grade level, again, the overall differences at both 
Fall and Spring favor non-Follow Through and significantly so. In Sponsor 
Group 1 and to a lesser extent in Sponsor Group 2, the Fa 11-to-Spring 
gains favtor Follow Through and are statistically reliable (p < .05) , As 
the bar graphs indicate, however, all of the Spring score comparisons 
show non— Follow Through children with higher average scores than Follow 
Through. 

Follow Through second graders as a whole showed si rhxi'i'’‘^nt larg^^r 
shifts to more positive attitudes tow<- oox • Jiian did non— Follow Through 
children (p < .05). When sponsor groups are contrasted, the patterns may 
be scan to vary. The sponsor group with the largest difference favoring 
Follow Through on this attitude measure is Sponsor Group 2. 

The measure of interpersonal feelings did not reveal a significant 
difference between Follow Through and non-Follow Through children overall. 
However , Sponsor Group 2, as in the measure of attitudes toward school, 
displayed the largest difference between the two groups that favored Follow 
Through. Sponsor Group 3 had approximately equal differences favoring 
non-Follow Through, 
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(s) Locus of Control. The Intellectual Achievement Responsi— 

& hility scale was used to measure the degree to which a 

(4) pupil feels responsible for his own academic success and 
failure. The "Success" and "Failure" scores appear 
separately in the profile. 

(5) Intrinsic Motivation. The Picture Motivation Scale 
assessed a pupil’s position on a theoretical continuum 
extending from intrinsic to extrinsic sources of motiva- 
tion. Intrinsic motivation is characterized by achieve- 
ment, mastery, creativity, enjojTtnent, responsibility, 
aesthetic interest, and psychological stimulation. At 

the other end of the scale, sources of extrinsic motivation 
include money, ease, safety, comfort, and general environ- 
mental security. 

(e) Attitudes Toward School. A longer and more comprehensive 
measure of attitudes toward school than the one used for 
the large samples of pupils reported eai'lier was obtained 
from a paper-and— pencil scale in which the children 
responded to such items as: "l ask the teacher a qu'^ 'on 

if I need help," "l like doing my school work," wc 
on things by myself," "l like to stand before the class 
and tell a story." 

(7) Teacher Ratings of Pupil Behavior. A 27 -item rating scale 
adapted from the Classroom Behavior Inventory was completeti 
by teachers on a randomly selected half of the children 
from each classroom in the non- cognitive sample. Items 
in the rating scale included attitudes toward school, 
task orientation, curiosity, autonomy, self-esteem, 
locus of control, evaluation anxiety, and so on. The 
summary score results reflect the extent to which the 
teacher Judged that a pupil’s behavior is adaptive to 
learning in the classroom. 

(s) Puzzle Task Competence and Anxiety. These two scales 
Ss were both obtained through observation of children's 

(9) ’behavior in structured puzzle-solving situatj.ons. The 
observation protocols represented observers* Judgments 
of the extent to which the pupil relied on himself, 
was competent in solving visual-motor problems, persisted 
to solution, exhibited caution, depended on external cues, 
and so on. , 
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Results 



A serier of tables (A-110 through A-118) appearing in Appendix A 
show the scores for Follow Through and non-Follow Through children 
according to sponsor groupings for each of the nine variables described 
above. The scores are presented in standard score form; the same logic 
£<nd procedures for standard score representation applied here as have 
been described earlier for achievement measures: briefly, Follow Through 

and non-Follow Through pupil scores in each project location separately 
were aggregated into a single distribution for the location or project 
whose mean was set equal to 50 with a standard deviation of 10. The 
Follow Through and non-Follow Through scores were then disaggregated, 
and separate Follow Through and non-Follow Through means and standard 
deviations were computed on the transformed scores. Because of the 
standardization, it is not possible to compare one sponsor group to 
another according to Follow Through or non-Follow Through means. It 
is possible, however, to contrast the differences between Follow Through 
and non— Follow Tiirough means across sponsor groupings. 



Table 26 summarizes the differences between Follow Through and 
non-Follow Through pupils within sponsor groups according to' grade 
level for each of the gross non-cogni tive variables described above. 

Table 23 contains only signs; plus (+) denotes that Follow Through 
mean scores exceeded non— Follow Through mean scores and minus (— ) denotes 
the reverse. It should be emphasized that the signs show the quantitative 
difference in the score values so that plus (+) and minus (— ) cannot be 
Interpreted as "good" and "bad" or "better" and "worse." The scoring 
of all non-cogni tive variables was such that a high score denotes a 
greater amount or degree of the trait. On two of the measures — school 
fearfulness and task anxiety--a negative difference between Follow 
Through and non-Follow Through, shown by a minus (-) sign, would mean 
lower scores on the fearfulness or anxiety measures by Follow Through 
pupils than by non-Follow Through pupils. In a valuational sense, most 
persons probably would judge such differences to be desirable. 



School Fearfulness — The Test Anxiety Scale for Children was adminis- 
tered to groups ox children at second and third grades in all four sponsor 
groups. The details appear in Table A-110 of Appendix A. In all compari- 
sons, the mean scores for Follow Through children were lower than those 
for non-Follow Through children^, thus indicating less apprehension 
about evaluation situations in school. In two of the four sponsor 
groups, the difference between Follow Through and non-Follow Through 
was clearly significant and, in a third, the difference approached 
statistical significance. The greatest difference was in Sponsor Group 4 
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TalDle 26 



NON-CCX5NITIVE MEASUREMENT PROFILE FOR A JUDGMENTAL SAMPLE 
OF PROJECTS REFLECTING FOUR SPONSOR GROUPS 



Variable 



School Grade 



1 



Sponsor Groups 

2 3 4 Total 



School tearful- 
ness 

Ethnic identity 



Second and third 
grades 

Kindergarten 
and firs t grades 

Second and third 
grades 






4 - + 



Locus of control Second and third 

grades 

Success 

Failure 



+ 












Intrinsic moti" 
vation 

Attitudes toward 
school 

Teacher ratings 



Puzzle task 
Competence 



Anxiety 



Second and third 
grades 

Second and third 
grades 

Kindergarten and 
first grades 

Second and third 
grades 

Kindergarten and 
first grades 

Second and t hi r d 
grades 

Kindergarten and 
first grades 

Second and third 
grades 







Note: Plus (+) signs denote that Follow Through mean scores exceeded 

non-Follow Through mean scores and minus (-) signs denote the 
reverse. On all variables, a higher score reflects more of the 
trait. For example, the negative or minus (-) signs on the 
school fearfulness'* measure mean lower **school fearfulness** 
scores for Follow Through than non-Follow Through. See 
TabT'es A-110 through A-118 in Appendix A for detailed 
summaries. ^ 



* p< ,05 

t P< ,01 . 




(p < .005),. followed by Sponsor Group 2 (p < .05), and Sponsor Group 1 
(p ^ .lo). The difference over all groups combined was significant 
(p ^ .OOl). On the basis of this judgmental sample of pupils, therefore, 
it appears that Follow Through children, regardless of the instructional 
Q-PP^os-uh they experience, are likely to be somewhat .less anxious in 
evaluation situations than are non~Follow Through children. 



Ethnic Identity — Randomly selected samples of children at all 
grade levels from kindergarten through three were given the ethnic 
pictures test. The details of these findings appear in Table A-111 
in Appendix A. None of the comparisons between Follow Through and non- 
Follow Through children in any of the sponsor groupings at any grade 
level showed clear differences favoring either Follow Through or non- 
Follow Through. Follow Through children produced higher scores than 
non-Follow Through, children at all grade levels in Sponsor Groups 2, 

3, and 4 but the only differences to approach statistical significance 
(p < .lO) were in kindergarten and first grade in Sponsor Group 2. In 
Sponsor Group 1 the mean differences favored non-Follow Through but the 
differences were small and not statistically significant. The differences 
between Follow Through and non— Follow Through over all sponsor groups 
combined were also not statistically significant. In considering this 
finding, it is important to reTsember that the standardized score repre- 
sentations show differences between Follow Through and non-Follow Through 
children and do not show the intensity of identification that the 
responses may imply. 



Locus of Control; Success and Failure — The Intellectual Achievement 
Responsibility scale yielded two subscores denoting the degree of inter- 
nality for locus of control. Half the items on the scale concerned 
responsibility for academic success while the other half dealt with 
responsibility for academic failure. Thus, a pupil's scores on the 
Success and Failure subscales reflected the degree to which he felt 
responsible for either outcome. This test was administered only to 
second and third grades. The detailed scores for success are shown 
in Table A- 112 and for failure in Table A-113 of Appendix A. 



Contrasts among sponsor groupings on these two scales showed some 
intersponsor differences as Table 26 reveals. Only Sponsor Group 1 
produced differences favoring Follow Through on the responsibility for 
success measure. The difference between Follow Through and non-Follow 
Through within Sponsor Group 1 was not statistically significant, however. 
For Sponsor Groups 2, 3, and 4 the direction of difference favored non- 
Follow Through. For Sponsor Groups 2 and 3, the differences were trivial. 
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For Sponsor Group 4, the difference was large enough to approach 
statistical significance (p < ,lo). Over all sponsor groups combined 
the difference, while favoring non-Follow Through, was not significant. 

The responsibility for failure subscale produced some statistically 
significant differences, whereas the responsibility for success scale 
did not. In both Sponsor Group 1 and Sponsor Group 4 the differences 
between Follow Through and non-Follow Through favored non-Follow Through 
and were statistically significant (p < .05 and p< .01, respectively). 

The difference in Sponsor Group 3 also favored non-Follow Through but 
was not significant. In Sponsor Group 2, however, higher scores were 
obtained from Follow Through pupils than from non-Follow Through pupils 
but the size of the difference was too small to be considered significant. 

The speculation of greatest interest that arises out of these two 
sets of scores comes from the contrast in patterns between Sponsor Group 1 
and Sponsor Group 2 since these two groups are the ones that tend to be 
most systematically different from one another in their approaches. At 
^ least two interpretations may be suggested, both of which are conjectural. 
On the one hand, the data suggest that a central conviction of the ap- 
proaches combined in Sponsor Group 1 is being transmitted to pupils 
through the medium of teachers. The theory holds that, since all 
organisms can learn, the "faTilt" for learning difficulties resides 
more in weaknesses in approach or instructional materials than in the 
^ been transmitted strongly to the 

reflected 

in their response patterns. By this argument it would not be inappropriate 
for pupilh in Sponsor Group i tbr^f^^ for their achievement 

rewarded for them. Similarly, it would not be 
inappropriate for them to not feel responsible for failure if teachers 
have communicated . to the children that difficulties in learning , were 
not so much their fault as the fault of the approach the teachers have 
-.-^used. . 



A somewhat contrary interpretation of the data might argue that 
the children in Sponsor Group 2 have approached a balanced recognition 
and acceptance of responsibility for both their success and failure 
and that such a balance is a positive indication of realistic self- 
appraisal. On both the responsibility for success and responsibility 
for failure scales, the children in Sponsor Group 2 are very close to 
. .. . the neutral point (i.e. , no difference between Follow Through and 

non-Follow Through) ; they are closer to this neutral; point than are 
the children in any of the other sponsor groups. The validity of this 
argument rests in part on the extent to which one is willing to accept 
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score that reflected the extent to which the teachers judged the pupils’ 
behavior to be adaptive to learning in the classroom environment. All 
of the differences among second and third graders shown in Table A-116 
of Appendix A and one of the two differences among kindergartners and 
first graders shown in the same table favored Follow Through pupils. 

None of the differences between Follow Through and non-Follow Through 
within sponsor groups was statistically significant, although the 
overall difference at second and third grades was reliable (p < .05). 

Comparisons of ratings provided by different teachers according to 
standards that may be idiosyncratic to individual teachers or a specific 
classroom must be interpreted with caution, particularly when comparisons 
are attempted between groups rated by different teachers. 



Puzzle Task Competence and Anxiety — Situational tests requiring 
pupils to solve puzzles were administered individually to random samples 
of pupils at levels from kindergarten through grade three. Two measures 
were derived from observing puzzie-taking behavior: ( l) an index of 

task competence that reflected ability to solve the puzzle and ( 2 ) a 
measure of task anxiety that reflected such child behavior in the 
puzzle-solving situation as sighing, talking to himself, or looking 
up for approval. Data from these two measures appear in Tables A-117 
through A- 118 in Appendix A. 




At the second and third grades, none of the comparisons between 
Follow Through and non-Follow Through children on the task competence 
measure was statistically signif icant . grades , however, 

Follow Through pupils in Sponsor Group 2 earned significantly higher 
scores than non-Follow Through pupils (p < .005). 



All of the comparisons at all grade levels of the task anxiety 
measures favored Follow Through pupils. At kindergarten and first 
grade these differences approached, but did not reach, statistical 
significance. At the second and third grades, only the comparison 
within Sponsor Group 4 reached statistical significance (p < .05), but 
the difference aggregated over all sponsor groups was statistically 
significant and favor^ Follow Through (p < .Ol). 



These findings on task anxiety lend support to the findings reported 



earlier on school fearfulness. These two sets of measures give a strong 
impression of Follow Through children displaying a greater sense of 
self-confidence and absence of anxiety in eyaluatiori'br problem-solving 
situations. While the magnitude-of the absolute difference small. 



the consistency: of difference compels notice. 



VIII RELATIONSHIPS AMONG SELECTED PUPIL, 

PARENT, , AND TEACHER VARIABLES 

This section contains ah examination of relationships among the 
measures of pupil achievement, attitudes toward school and interpersonal 
feelings, and relates these pupil measures, in turn, to measures of 
parents’ awareness and participation, family life style variables, and 
teacher characteristics. 

These relationships have been examined in the most direct way pos- 
sible by casting the measures of parent awareness and participation, life 
style variables, and teacher characteristics as independent variables in 
cross-tabulations that contrast Follow Through and non-Follow Through 
children on the pupil measures. The relationships among the- dependent 
variable measures of pupil achievement, attitudes, and interpersonal feel- 
ings have relied heavily on bivariate correlations. Analyses using more 
sophisticated multivariate regression . and other techniques are not yet 
completed. 

This section presents the following parts in sequence: 

(1) Parent awareness and participation related to pupil achieve- 
ment and attitude 



(2) Family life style related to pupi]. achievement and attitudes 

(3) Kindergarten teacher characteristics related to kindergarten 
pupil achievement 

(4) Relationships among pupil measures of achievement, attitudes 
toward school, and interpersonal feelings 

(5) Relationships among non-cognitive, achievement, and attitude 
measures. 



Relationships Among Measures of Parent Awaren ess and 
Participation, and Pupil Achievement and Attitudes 



In Section VI a number of outcome measures were identified on which 
Follow Through and non-Follow Through parents differed. These measures 
of parents’ behavior and b ’^efs all refer to outcomes desired by Follow 
Through, either as reflected generally in the Guidelines or specified by 
various program approaches. To review, these variables were: 

( 1) Parent awareness of classroom activities 

(2) Parent/school contacts beyond the classroom 

( 3) Parent works in classroom or school 

(4) Visits to classroom by family members 

(5) Recency of parent/teacher talks 

(6) Parent general satisfaction with child's school 

(7) Parent sense of influence and control . over , school 

( 8 ) Parent feelings that his ideas matter to those who run the 

schools 

(9) Parent involvement in social and political groups 

(10) Follow Through parents 'awareness of the PAG. 

In most Follow Through projects, efforts are directed toward making 
parehts more aware of what is happening in the classroom, increasing the 
f requexicy of their contact wi th school personnel , helping them increase 
their involvement in school affairs, and so on. These objectives, as 
the discussion in Section VI emphasized, are being realized in greater 
or lesser degree throughout all Follow Through projects. Follow Through 
also seeks to increase children's ability to succeed in school (as measured 
in the evaluation by achievement test performance) and to help children 
develop more positive attitudes toward school and warmer and more trusting 
interpersoxial relationships. These objectives, too, are being achieved, 
particularly at entering grade levels, as the data in Section VII 
demonstrated. 



Changes in both parent and in child behavior and beliefs are con- 
sidered important in their own right. It is also hoped that the two sets 
of behaviors will be mutually reinforcing. It to this interaction 
that the discussion below is addressed. 

T.ie data discussed are limited to childrei at kindergarten and en- 
tering first grade the Follow Through childr.a who are the first to ex- 
perience reasonably well established program approaches. The data are 
summarized in Tables A-119 through A-127 in Appendix A , and signs 
rather than quantities are used to denote direction of differences between 
Follow Through and non-Follow Through children on three contrasts: ( l) 

the Fall, or pre-test, measure, (2) the Spring, or post-test, measure 
and (3) the difference between Fall and Spring scores, or the gain measure 
As in the earlier sign tables, a plus ( +) sign on the achievement measure 
and a negative ( -) sign on the two attitude measures shows that Follow 
Through children exceed non-Follow Through children in the desirable 
direction. The signs again appear in sets of three: the first sign de- 

notes the difference between Follow Through and non-Follow Through at the 
Fall ppint, the middle sign shows the difference at the Spripg point, and 
the third sign designates the difference in the gain. 



Parent Awareness of Classroom Activitie s 

Overall, at both kindergarten and entering first grade, there is no 
obvious relationship between parent awareness and child performance. 

There is some suggestion that the children of parents who are moderately 
aware (neither most nor least aware) do less well on achievement measures 
than children of parents who are most and least aware of classroom activ- 
ities. This relationship, although weak, is probably accurate if one 
assumes that the most usual reason for a contact between parent and 
teacher is to discuss a child's problems. From this it would follow that 
(1) parents of children who were not doing well in school would likely 
be specifically requested to visit the teacher or the classroom and ( 2 ) 
parents of children who were doing well in school usually would be the 

ones most likely to seek information voluntarily about classroom activ- 
ities. 



When the sponsor groups are contrasted, one pattern deviates somewhat 
from the overall. In Sponsor Group 2 , there is a tendency for least par- 
ent awareness of classroom activity to be associated with the least positive 

pattern of child performance; this relationship stands in contrast to the 
other sponsor groups. 




The relationship between parent awareness and children's attitudes 
toward school suggests the following: 

( l) Children of parents who are most aware of the classroom activity 
tend to show a shift toward more positive attitudes during the 
school year. 

(2) Children of parents who are least aware of classroom activities 
are less likely to show any shift in attitudes or, if a shift 
occurs, to shift toward a less positive attitude. 

The relationships, to be sure, are weak overall and are not equally ap- 
parent in each sponsor group. 

No consistent pattern is apparent in the relationship between parent 
awareness of classroom activities and a measure of children's interpersonal 
feelings. A shift toward more positive interpersonal feelings seemed 
somewhat more likely to be shown by children of parents who were most 
aware of classroom activities in contrast to children of parents who were 
least aware but this association was weak at best. 

Parent/School Contacts Beyond the Classroo m 

These parent contacts with the school refer to persons other than 
the classroom teacher, such as the school nurse , principal , or a social 
worker. Thus , high contact most commonly would be associated with a 
specixic family need or problem. When parent behavior is examined in 
relation to pupil achievement, some support for this interpretation may 
be seen. For example, there was a slight tendency for more frequent con- 
tacts to be associaited with negative changes in children's achievement 
between the Fall and Spring points. 

When frequency of parent contact was examined with regard to children's 
attitudes toward school, shifts toward more positive attitudes were more 
likely to be displayed by children of parents who had some or frequent 
contact with the school in contrast to those who had none. Essentially 
the same trend was reflected in children's interpersonal feelings as in 
their attitudes toward school: contacts with the school by parents were 

related with a shift toward more positive interpersonal feelings by 
children. 
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Parent Works in Classroom or School 



Three categories of work — as a volunteer, as r s^aid worker, or not 
at all — were recorded for parents. .No clear re?latiOi iships were evident 
between parents' working and child Sihievement, nlthtjugh part of the in- 
ability to detect such may be due to the fact tinat t very small fraction 
of non-Follow Through parents worked eitheo- as volun teers or for pay. 
Children of parents who were paid to work in the classroom seem to be 
the best performers in Sponsor Group 1. In contrast, the test performers 
in Sponsor Group 2 appear to be the children of parer.ts who worked as 
volunteers. The available data do not suggest that child achievement was 
strongly influenced one way or another by the fact that a parent works 
either for pay or as a volunteer. 

Similarly, children's attitudes toward school dc not appear to be 
related in predictable ways with the fact that their parents work in the 
classroom. If anything, there is a slight tendency z •'r more desirable 
shifts in attitude to be associated with the fact that a mother does not 
work in the classroom. 

The association between children's interpersonal feelings and work 
in the classroom by parents was equally indeterminate. 



Visits to the Classroom by Family Memb ers 

Classroom visits was a part of the "awareness” variable discussed 
^ similar pattern of relationship between visits and child 
achievement was detectable: the children with the most desirable achieve- 

ment patterns tended to be those whose parents have either not visited 
the classroom at all (presumably because the child is doing well) or have 
visited the classroom many times. 

The relationship of classroom visits to attitudes was somewhat sim- 
ilar but was more likely to differ from one sponsor group to another. In 
Sponsor Group 2, shifts toward more positive attitudes were more likely 
to be shown by children of parents who had made one or two visits in con- 
trast either to many visits or no visits. On the other hand, a reverse 
of this pattern was reflected in Sponsor Group 1 where most positive 
attitudes were associated with either no visits or many. 



Children's scores on the interpersonal feelings measure did not seem 
to be associated in any clear way with the frequency of visits to the 
classroom by the parent. There was some hint that frequent visits were 
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more likely to be made by parents of children whose interpersonal feelings 
scores were least desirable, but this tendency was a weak one. 



Recency of Parent/Teacher Talks 

Parents of children whose achievement pattern indicated that they 
either were not performing well at the outset of the year or performed 
less well later in the year were somewhat more likely than other parents 
to have had recent visits with the teacher. This pattern is consistent 
with the interpretation suggested earlier with respect to general parent 
awareness of classroom activities. 

In at least Sponsor Groups 1 and 2, children of parents who had had 
most recent visits with the teacher were somewhat more likely to show a 
shift toward more positive attitudes toward school. A reverse of that 
pattern, however, is suggested in Sponsor Group 3 in which the most pos- 
itive attitude shifts were shown by children whose parents had either 
not talked with the teacher at all or had done so more than a month ago. 

Children’s scores on the interpersonal feelings measure, when ex- 
amined in relation to parents’ talks with the teacher, showed essentially 
the same pattern as displayed on the attitudes toward school index. 

Shifts toward more positive interpersonal feelings were somewhat more 
likely to be shown by children whose parents had had recent talks with 
the teacher — especially for Sponsor Groups 1 and 2 — than by children whose 
parents had never talked with the teacher or had not done so for at least 
a month. 



Parent General Satisfaction with Child;’s School 

The relationship of parents ' satisfaction to child’s achievement 
showed consistent but complementary patterns for Sponsor Groups 1 and 3. 

In Sponsor Group 1, highest levels of satisfaction tended to be associated 
with children's gains; in Sponsor Group 3, lower levels of satisfaction 
were associated with children’s losses. No relationship between parent 
satisfaction and child achievement was detectable in either Sponsor 
Group 2 or Sponsor Group 4, 

A pattern similar to that between parent satisfaction and achievement 
was suggested by the data that related the former to children’s attitudes 
toward school. 




No sensible pattern is evident in the data that related parent sat- 
isfaction with children's scores on the interpersonal feelings scale. 

If anything, these data suggested that more positive interpersonal feelings 
by children were associated with lower levels of satisfaction by Follow 
Through parents. 



Parent Sense of Influence and Control Over Schoo ls 

In Sponsor Group 3, there was some indication that a high sense of 
control was associated with both higher levels of achievement and greater 
gains in achievement. In Sponsor Groups 1 and 2, however, the relation- 
ships were more obscure and even suggested the possibility that a moderate 
sense of control, rather than a high or low sense of control, was more 
likely to be associated with better achievement by Follow Through children. 

The measure of children's attitudes toward school, when viewed in 
relation to the parents' sense of influence, showed a pattern similar to 
that for pupil achievement except that the positions of Sponsor Groups 1 
and 3 were reversed: in Sponsor Group 3, shifts toward more positive 

attitudes were more likely to be associated with a low sense of control 
by parents, whereas in Sponsor Group 1 they were associated with a high 
sense of control. 

Parents' sense of influence over the schools and children's scores 
on the interpersonal feelings scale do not appear to be related in any 
systematic way. ’ 



Parent Feelings That His Ideas Matter 

Only in Sponsor Group 1 was a plausible pattern evident between the 
parents' feelings that his ideas matter and the child's performance on 
the achievement measure. In this sponsor group, a weak but discernible 
tendency existed for better patterns of achievement to be displayed by 
children of parents who felt that their ideas were important to those who 
run the schools. In Sponsor Groups 2 and 3, no pattern was seen. 

Pupils' attitudes toward school seemed to follow more favorable pat- 
terns of change among children whose parents were moderate in feelings 
about whether their ideas mattered. 

No interpretable relationship was perceived between children's scores 
on the interpersonal feelings measure and parents ' feelings regarding the 
value of their own ideas. In one sponsor group it appeared that the most 




desirable changes by children were associated with parents' feelings that 
their ideas did not matter. In another sponsor group the most favorable 
shifts by children occurred among those whose parents felt most strongly 
that their ideas did matter. ^ 



Parent Involvement in ‘Social and Political Gr oups 

Overall, the most desirable patterns of child achievement were dis- 
played by children whose parents reported either high involvement or low 
involvement ( rather than an intermediate level of involvement) in social 
and political groups. Sponsor Groups 2 and 3, however, showed somewhat 
contradictory patterns. In Sponsor Group 2 the most desirable patterns 
of pupil change in achievement were shown by children whose parents re- 
ported high involvement. In Sponsor Group 3 the most desirable patterns 
were displayed by those children whose parents reported low involvement. 

Children's attitudes toward school, as well as their scores on the 
interpersonal feelings measure, both tended to show somewhat more desirable 
shifts among those whose parents reported low, rather than high, involve- 
ment in social and political groups. 

Follow Through Parents Awareness of the PAC 



It was noted earlier ( Section VI ) that Follow Through parents in 
Sponsor Group 2 were most likely *to report an awareness of the PAC. This 
outcome vms most visible at kindergarten and non-entering first grade 
since, at those grade levels, Sponsor Group 2 included two projects that 
follow the model of Sponsor N. The relationship of Follow Through parents ' 
awareness of PAC and children's performance on achievement measures cor- 
related in somewhat different ways at each grade level due to the dominance 
of Sponsor N in Sponsor Group 2. Over allsponsor groups , the relation- 
ship between pupil achievement and parent awareness of PAC was weak and 
negative at the kindergarten level, moderately high and positive at enter- 
ing first grade, essentially zero at non-entering first grade, and moderate 
but positive at second grade. 

When data were summed over all grade levels according to sponsor 
group, the net effect was for a moderately high positive relationship to 
obtain between children's achievement and parents' awareness of PAC. The 
primary reason for this moderately high overall relationship was the con- 
sistent pattern displayed by parents and children in Sponsor Group 1. At 
all grade levels, children in this sponsor group showed the highest pattern 




of achievement. In addition, parents of children in this sponsor group 
were, at all grade levels, above the average of all Follow Through par- 
ents in their awareness of the PAC. 

There is no table in Appendix A to reflect these data since there 
were no contrasts between Follow Through and non-Follow Through. 

In summary: the net impression from efforts to rationalize rela- 

tionships between measures of parent awareness/participation and children's 
achievement/attitudes is that no systematically useful overall associations 
exist although the patterns within some sponsor groups were moderately 
consistent. For example, Sponsor Group 2 showed stronger indications of 
parent awareness of classroom activities and of their own influence in 
school matters. However, because this sponsor group does not show as 
high patterns of pupil achievement as do some others, it is difficult to 
develop plausible interpretations of relationships between parent behavior 
and beliefs and child performance and attitudes. 

Sponsor Group 1, as has been observed, includes the children who 
most regularly display the highest scores on the pupil achievement mea- 
sures, Parents in Sponsor Group 1 seem to be moderately well informed 
about classroom activities. 



Children and parents in Sponsor Group 3 displayed a pattern that was 
generally mixed, which may be fitting to the eclectic character of that 
sponsor grouping. Sponsor Group 4, by definition, is a heterogeneous 
collection of projects that shared in common only the fact that they are 
all self-sponsored. As a grouping of projects, those in Sponsor Group 4 
evinced high patterns of child achievement relative to non— Follow Through 
at the kindergarten level but were much less likely to do so at higher 
grade levels. It is notable, however, that the contrast between Follow 
Through and non-Follow Through parents on such measures as feelings of 
satisfaction toward children's progress and a sense that their ideas 
mattered was seen most sharply in this sponsor group. 



Relationships Among Family Life Style Variables and Pupil A chievement 
and Attitudes 

A number of variables descriptive of family life style were examined 
for their relationship to the outcome measures of pupil achievement, at- 
titudes toward school, and interperspnal feelings . The basic set of 
Variables, used in tabulations at all grade levels for each grouping of 
sponsors, are defined operationally in Appendix 8 . Differences between 
Follow Through and non-Follow Through families on these same variables 
were described in Section VI. 

Analyses of these life style variables in relation to child achieve- 
ment and attitudes , do not reveal an orderly patter n. Overall, there is 
no consistent relationship, from one grade level to another or among 
sponsor groupings. What does emerge, however, is a pattern of associa- 
tion between the poverty level and pupil achievement at all grades tested 
and among all sponsors. This pattern showed clearly and repeatedly 
throughout Figures 1 to 13. The life style variables, in turn, also tend 
(with rare and inconsistent exceptions) to be associated with poverty 
level. No instance of consequence was found in which a relationship 
between a life style variable and poverty level obtained for Follow 
Through families and did not also hold for nbn-Follow Through families. 

To summarize ; 

( i) Poverty level and pupil performance and attitudes usually 
are related; these associations were shown in Figures 1 

.r '-' ;-rV/thrOUgh'12.,;-' 

; , ( 2 ) .Poverty level and family life style variables usually are 

related . 

( 3 ) Life style variables and pupil achievement and attitude 

measures often are related, but seldom as strongly as the 
relationships between poverty and pupil performance. 



( 4 ) Follow Through and non-Follow Through families usually do 
not differ systematically from one another on the life 
style measures when poverty level is held constant. 



The following tabulations illustrate these points. The first two 
tabulations show relationships--first for Follow Through and then for 
non-Follow Through families at all grade levels combined— between a 
measure of parent-child involvement and level of poverty. (This measure 
of involvement means that the parent takes the child shopping and on 
out -bfr-town' '.trips 




Percent of 

Follow Through Families 





by Poverty Classification 




Parent 

Involves Child 


Certain 

Poverty 


Possible 

Poverty 


Not 

Poverty 


Total 


Frequently 

Moderately 

Infrequently 


13.1% 

46.3 

40.6 


19.0% 

52.1 

28.9 


31.6% 

48.4 

19.9 


21.2% 

48.5 

30.4 


Total 


100.0% 


100.0% 


100.0% 


100.0% 




( 1,035) 


(641) 


( 923) 


(2,599) 



The chi square value for this distribution is 152.59 (p < .OOl) and the 
contingency coefficient is .236. 

; A non— Follow Through families is nearly 

identical':' 



Parent 

Involves Child 
Frequently 



Infrequently 

Total 



Percent of 

Non-Follow Through Families by 
Poverty Classifi cation 
Certain Possible Not 

Poverty Poverty Poverty 



14.3% 
45.0 
40 .7 

100 . 0 % 

(460) 



21 . 0 % 

51.0 

28.1 

100 . 0 % 

(310) 



34.4' 

50.7 

15.0 

100 . 0 ^ 

(675) 



Total 

25.1% 

48.9 

26.0 

100 . 0 % 

(1,445) 



This distribution produces a chi square of 118.75 (p < .001) and a 
contingency coefficient of .276. 

The frequency ,with which the parent involves the child clearly is 
related to poverty, but the question of whether this association is- dif- 
ferent for Follow Through than for non-Follow Through can be answered by 
the following reclassification of the above data: 
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Parent 

Involves Child 


Percent 

Possible 

Follow 

Through 


of Certain and 
Poverty Families 
Non— Follow 
Through 


Total 


Frequently 


15.4^ 


17.0^ 


15.95^ 


Moderately 


48.5 


47.4 


48.2 


Infrequently 


36.1 


'• 6 . 


35.9 


Total 


100.0^ 


100 . 0 ^ 


100.0^ 




(1,676) 


(770) 


(2,446) 


The chi square obtained 


from this distribution is 1.042 


(p > .50) ; 



contingency coefficient of .021 affirms the absence of a relationship. 

l®ss poor Follow Through and non-Follow Through families 
are compared, a slight difference is revealed: 

_ Percent ; of 

Not Poverty Families 
Parent Fol low ^ ^ ^ V 

Involves Child Through Through Total 

■ ;;Frequeiitly; ;/ 31. 6^ ', . ; J.32 .,8% ^ : , : 

Mpderately'; ' - ■ ,49v4‘'-. 

Infrequently 19.9 15.0 17.8 

Total 100.0^ 100 .0^ 100.0^ 

- ;■ ' 

This distribution is described by a chi square value of 6.689 (p < .05), 
but the cont ingency coefficient of ,065 shows that the relationship is a 
weak one . 




Relationships of Kindergarten Teacher Charac teristics and 
Practices to Kindergarten Pupil Achievement ~~ 



In Section V preliminary comparisons of Follow Through and non- 
Follow Through teachers were presented. As noted in that section, a 

analysis of these data has not yet been completed. However, some 
of the teacher characteristics and practices as they relate to kinder- 
gartners’ achievement are discussed below. 



Teacher Age and Ethnic Origin 



Differences between Follow Through and non— Follow Through pupils on 
achievement test scores were not statistically significant at any teache: 
age stratum. The category in which the largest difference favoring Foil 
Through occurred was in the teacher age range from 30 to 39; in this 
classification the s igni f icance o f the di f f ef ence between Follow Through 
and non-Follow Through pupils was less than .20. Differences 'between 
Follow Through and non-Foirow Through were ieven less likely to be signi- 
ficant for ages below 30 and above 39. 

Comparisons between Follow Through and non-Follow Through pupils 
according to ethnic origin of the teacher did not show statistically 
significant differences . 



Te acher * s Academic Background 'and Cer t i f i c at ion 

The only level of teacher academic background in which the differ- 
ences between Follow Through and non-Follow Through pupils approached 
stat istical sig;nif ic was among teachers who had earned masters degree 

In this category, the difference favoring Follow Through was significant 
at about the . 15 level . 



Consistent with these findings there also was some tendency for the 
largest difference between Follow Through and non— Follow Through pupils 
to occur among teachers who held the highest level of certification 
granted. This difference was significant at about the .15 level. 

Formal Training in Teaching Disadvantaged Children 



■ --At: first glance these findings appeared startling, for the category 

which shows the largest apparent difference between Follow Through and 



non-Follow Through pupils are the teachers who had no prior training in 
teaching disadvantaged children. Upon reflection, however, this differ- 
ence may be explained by the impact of sponsor support and sponsor mate- 
rials on Follow Through teachers. The difference favoring Follow Through 
was significant at the .05 level. 

It is curious to note that the Follow Through teachers whose pupils 
showed the smallest mean gain in academic scores during the 1969-70 
school year were those who rated their formal training in teaching dis- 
advantaged children as very helpful. 



On-the-Job Teacher Training 



The difference between Follow Through and non-Follow Through pUipils, 
both of which were instructed tsyr teachers had received can-the-job 

training that they fudged help&ii,„ was startistdcally significant (p .05) 
and favored Follow Through . ISfcis finding ;al2so supports the imferencs 
that sponsor supporr and IbcaE- tzxsining im Ebllow Through has b€;en cssm- 
structive . 

P€j <rceived Advantages in Teaching in Follow Through 

Contrasts between pupils with teachers who shared similar judgements 
regarding the advantage of teaching in Follow Through were not statisti- 
cally significant .However , among Follow Through teachers , the group 
whose pupils showed the greatest gains during the school year were^ those 
who perceived much advantage (in contrast to some or ho advantage) in 
teaching in Follow Through. 

Teacher Satisfaction with Pupil Progress 

Follow Through pupils with teachers who said they were very satis- 
fied with their pupils’ progress performed significantly better than non- 
Follow Through pupils with teachers who also reported high satisfaction. 
This difference was significant at less than the .01 level. Furthermore, 
among Follow Through teachers, a strong association was evident between 
the teachers' report of satisfaction; and the mean gain demonstrated by 
their pupils during 1969-70. This strong association stands in contrast 
to an absence of relationship between pupil gains and teacher satisfac- 
tion among non-Follow Through teachers . 




Home Visits by Teachers 



Follow Through and non-Follow Through teachers differed greatly in 
the proportion of home visits reported. Half of the non-Follow Through 
teachers reported no visits whatsoever, one-fourth reported from one to 
five visits, and the remainder reported six or more visits; the median 
number of visits was just less than 1.0. Follow Through teachers, in 
contrast, were far more likely to report home visits; more than 77.0% 
of them reported one or more home visits and the median number of visits 
for all Follow Through teachers was 9.0, 

Despite differences between FoTlow Through and non-Follow Through 
teachers in the number of home visi"ts reported, there were no significant 
differences between Follow Through and non-Follow Through pupils in mea- 
sured achievement in any of the "number of visits' categories. 

Both Follow Through and non-Follow Through teachers iprovided infor- 
***^ii*^i^ the kinds of persons who made home visiits (fiseachers, aides, 

social workers, and others) . Among non-FoZlnw trough teachers, more 
than two-thirds of the visits reported were;^ made by teachers. Within 
Follow Through, home visits were more equalDly distributed among teachers, 
aides, social workers , and other personnel.. There were no clear ! differ- 
ences in pupil performance associated with the isidentity of the person 
making the home visit. 

Follow Through and non-Follow Through teachers differed sligiifcly in 
their judgments of the importance of home visits. As their behavior 
would suggest. Follow Through teachers were more likely to judge liome 
visits to be very important. The largest difference (although not a 
statistically significant one) between Follow Through and non-Follow 
Through pupils on achievement, however, occurred among those pupils whose 
teachers did not consider visits very important. 



Parent Participation in Classroom Activities 



Teachers were asked whether they thought that parent participation 
in classroom activities should be greater than it now is, remain about 
the same, or be less. Follow Through and non-Follow Through teachers 
differed in these assessments (p < .025 by chi square) . Follow Through 
teachers generally were more supportive of increased parent participation 








in the classroom, although the modal response for both Follow Through 
and non-Follow Through teachers was for the level to remain the same. 
There were no statistically significant differences betw^oen Follow 
Through and non-Follow Through pupils in achievement accoarding to 
teachers’ judgments about parent participation. 



Number of Assistants and Volunteers in the Classroom 

Follow Through teachers are far more likely to have assistants in 
the classroom than are non— Follow Through teachers. Only one Follow 
ThEEDUgh teacher of the approximately 290 responding to the survey 
reported no assistant in the classroom. In comtrast, of the nion- 

FoTlow Through teachers had no assistants and only 3 ouitr of 64 non-Follow 
TlvroiUgh teachers reportiing an assistant indicated that itiKffiy had more than 
osia 42% of the Follow TKirough teachers had mcnre than eras- assistant, 
l^ere were no significant differences in pupilL achieveimant according to 
tSoie number cfff assistants reported. 

Follow Through and non-Follow Through teachers alsro differed con- 
saiderably in the presence of volunteers in their classrojoms. Among non- 
Follow Through teachers, 86% reported ho volunteers, whereas within Follow 
Through the corresponding percentage was 59%. A statistically significant 
difference in pupil achievement was noted for Follow Through and non- 
Follow Through teachers who had two volunteers. Although the total number 
of cases with pupil scores available was small (nine Follow Through and 
five non-Follow Through) , the difference, favoring Follow Through, was 
significant at less than the .02 level. 
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Relationships Among Measures of Pupil Achievement, Attitude To ward 
Schcsfll^^ and Interpersonal Feelings 



The findings presented below are based on Fall and Scaring pupil 
scores on the achievement battery^ the attitude scale dealing with feel- 
ings sabout school, and the attitude scale concerned with iinterpersonal 
relationships. Most of the data are from 18 kindergarten ^projects In 
which both Pall and Spring tests were administered. Pour projects are 
in Sponsor Group 1, five in Sponsor Group four in Sponsor Group 3, 
four in Sponsor Group 4, and one in Sponsor Group 5. In aill , the number 
of (Children in the 18 projects totaled 1,552 for Follow Through and 894 
for non-Follow Through. 



Two measures were used in computing correlations to exaiznine these 
relationships. One was the Fall-to~Spring change score, deefined as: 

(post - pre) = Change 

The second was the difference between change scores, defined as: 

^ N ~ Difference 

^ A post— pre; (post -pre) 

In one set of analyses, pupils were categorized according to level 
of poverty within the project. In another analysis, the project- average 
across all poverty classifications was used as the unit . For correlations 
from the non-cognitlve Study, the pupil was the unit. Both sets of cor- 
relations are summarized in Table 27. 

Overall, there is a. small but perceptible relationship between 
different score measures of pupil achievement and attitude toward school. 
This relationship is in the expected and desired direction — higher 
achievement gains tend to be associated with positive changes in atti- 
tude toward school. (These correlations appear as negative in Table 27 
since a low score on the attitude measure denotes a positive attitude.) 



The relationship between achievement and attitude toward school 
holds for all sponsor groups except Sponsor Group 1, in which the cor- 
relation did not differ significantly from zero. In Sponsor Groups 2 
and 3, by contrast, the correlation reached statistically significant 
levels (p < .01 and p < .002, respectively) despite the similarly small 
number of units. In Sponsor Group 4, the correlation is marginally 
reliable (.20 >p > .lo). The number of subcategories in Sponsor Group 5 
was too small to permit a generalization about the relationship. 
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Table 27 



CORRELATIONS BETWEEN STANDARDIZED MEASURES OF SCHOOD ACHIEVEMENT, 
ATTITUDES TOWARD SCHOOL AND LEARNING, AND INTERPERSONAI. FEELINGS 
FOR KINDERGARTNERS AND FIRST GRADERS 



Correlations Between Change (post-pre) Measures 











Attitudes to 






Achievement 


Achievement vs. 


School vs . 


Group 


N 


vs. Attitudes 
to School’^ 


Interpersonal 

Feelings'*^ 


Interpersonal 

Feelings 


FT 


18 projects 


,068 


.011 


.711 


NFT 


18 projects 


-.417 


-.136 


.650 


FT (K & 3.) 


^120 pupils 


-.092 


-.058 


.333 


NFT (K & l) 


'^lOO pupils 


-.189 


-.035 


.369> 




Correlations Between Difference 


(ft , - NFT ) Measures 

change change 


Ail projects 


18 


-.314 


-.126 


.714 


All projects 


63 poverty 
categories 
( 18 projects) 


-.242 


.031 


.505 


Sponsor 


14 povert y 








Group 1 


categories 
(4 projects) 


.079 


.373 


.148 


Sponsor 


15 poverty 






' 'I . ' ■ ' ■ 


Group 2 


categories 
(5 projects) 


-.645 


.169 


.494 


Sponsor 


16 povert y 








Group 3 


categories 
( 4 projects ) 


-.720 


-.051 


.650 


Sponsor 


15 poverty 








Group 4 


categories 
( 4 projects ) 


-.392 


-.444 


.702 


Sponsor 


3 poverty 








Group 5 


categories 
( 1 project ) 


-.865 


.385 


. 130 



On the two attitude measures, lower scores denote more positive feelings 
On the achievement measures, higher scores denote superior achievement. 
Thus, a negative correlation between an attitude and achievement measure 

denotes achievement gain and positive change in attitudes 



If attitude toward school is thought of as a predictor of achieve- 
ment, then this evidence suggests that negative attitudes toward school 
are better predictors of low achievement than positive attitudes are 
indicators of high achievement. Stated another way, the relationships 
between achievement and measures of attitude toward school are strongest 
in those sponsor groups in which the achievement difference scores are 
lowest (i.e., tend to favor non-Follow Through). 

The strength of association between achievement gain and attitude 
coward school appears larger among non-Follow Through than among Follow 
Through pupils. For the 18 kindergarten projects, the correlation among 
iton— Follow Through pupils v/as .42 but was essentially zero for Follow 
Through pupils. (part of this difference in correlation almost certainly 
is due to the greater variability in both achievement and attitude mea- 
jsures for non-Follow Through children. On the attitude measure, for ex- 
ample, the variance for uon-Follow Through was 6.19 in contrast to 4.19 
for Follow Through.) 

Achievement measures, expressed either as change scores or as dif- 
ference scores, were not associated reliably with the measure of inter- 
personal feelings. The overall direction of the association was that 
which would be desired — -higher achievement tended to be associated with 
more positive interpersonal feelings — but the magnitude of the relation- 
ship v/as too low to be considered statistically significant. Further, 
the relationship was erratic over sponsor groups. 

The overall relationship between attitudes toward school and inter- 
personal feelings was fairly strong and consistently positive, and did 
not differ substantially between Follow Through and non— Follow Through 
children. Similarly, the relationship was moderately high within all 
sponsor groups except Sponsor Group 1. 

Generalized attitudes toward school and learning, and feelings about 
teachers and classmates clearly are not independent of one another. Nev- 
ertheless, the two attitudinal measures are not interchangable as shown 
by the differences between them in the \vi?.ys that they are associated with 
measures of achievement. 



O 
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Relati onshi.ps Among Non-Cognit ive. Achievement, and Attitude Measures 

As reported in an earlier section, a pilot study was undertaken in 
Spring 1970 to try out a number of measures of non-cognitive attributes 
that figured prominently in the objectives of several of the Follow 
Through approaches. A total of approximately 850 children in kinder- 
garten through grade three were included in that pilot study, although not 
all of the non-cognitive measures were applied at all these grade levels. 
Since these same children had also participated in the achievement test- 
ing and had responded to the two attitude measures that accompanied it 
(attitudes toward school and interpersonal feelings), it was possible to 
examine the interrelationships among these several measures. 

Tables 28 and 29 display correlations among the non-cognitive, 
achievement, and attitude variables for four subsets of children, 

*^®hle 28 shows the correlations for children at kindergarten and first 
grade, and Table 29 presents the correlaiions for pupils at second and 
third grade. 

The variables reflected in the congelation matrices were described 
in detail at the end of Section VII. The matrices also include six mea- 
sures derived from the achievement battery and the school attitudes and 
interpersonal feelings scales. Three of these are the post, or Spring, 
scores on each measure and the other three are the change, or gain, 
scores between Fall and Spring. The correlation matrix for kindergarten 
and first grade contains four non-cognitive variables and the six mea- 
sures derived from the classroom battery. The matrix for second and 
third grades includes nine non-cognitive measures in addition to the 
six derived from the classroom achievement battery. 

One complication in interpreting the correlation matrix arises from 
the fact that varying numbers of children are reported in each coefficient, 
thus making it impossible to specify a single value that will represent a 
J^on— zero relationship. A coefficient of .20 or greater in the 
kindergarten and first grade matrix can be considered significant at the 
.05 level or less.. In the second and third grade matrix, a coefficient 
of at least .15 will be significant at or below the same level. 

The two attitude scales used in the classroom battery (attitudes 
toward school and interpersonal feelings) were both scored to yield a 
lower score for the more positive attitude. In the correlation matrices 
shown in Table s 28 and 29, the signs on correlations involving these mea- 
sures have been reversed so that a positive correlation between one of 




CORRELATIONS OF NON-COGNITIVE, ACHIEVEMENT, AND ATTITUDE SCORES’ 
FOR FOLLOW THROUGH AND NDN-FDLLOW THROUGH 
KINDERGARTNERS AND FIRST GRADERS 
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Follow Through correlations appear above the diagonal (1.0) and non- Follow Through correlations below it. 
t Variables 11 and 14 are the school attitudes measure included as an element of the achievement test battery. 
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Follow Through correlations appear above the diagonal (1,0) and non-Follow Through correlations below it, 
Variable 6 is based on the non-cognitive test, "in My Classroom." Variables 11 and 14 are the school attitudes 
measure included as an element of :the achievement test battery. 



these attitude scores and another variable reflects a positive relation- 
ship between attitudes and the other measure. On all of the non-cognitive 
measures the scoring is such that a high score represents a greater amount 
of the attribute in question. This applies even to those measures such 
as the school fearfulness and task anxiety scores in which a low score 
would be considered most desirable. 

Both Tables 28 and 29 reflect a general absence of high correlations 
among the non— cognitive measures. The predominance of generally low cor- 
relations supports the discriminant validity of the non-cognitive scores. 
The highest correlations in both matrices tend to be between the alter- 
nate expressions of the same variables (e.g. , the post score on an atti- 
tude measure and the change score on an attitude measure). Correlations 
between the two expressions of the achievement measure (the post score 
and the change score) tend to be less high than correlations between post 
and change scores on the attitude measures.- The principal reason for 
higher correlations between the alternate Expressions of. the attitude 
scores (post vs change) than for the achievement Scores (post vs change) 
can be readily seen in bivariate plots. The attitude scores typically 
were skewed on both the Fall and Spring distributions; about half the 
children made the most postive of three possible responses each time, 
I^^^fher, t.hose who responded positively in the Fall were very unlikely 
to shift to a rating less favorable than one scale point if they shifted 
at all. On the achievement measure, in contrast, pupil.^ whose scores 
were low in -the Fall were most likely to show large gains owing to the 
combination of regression effects and some ceiling limitations of the 
battery. 

The comments which follow are speculative; such speculation may be 
excused if it triggers alternate explanations that also may be tested 
with these or smiliar children at later times. 



Kindergarten and First Grade Correlations 



A dominant relationship in both the Fellow Through and non— Follow 
Through matrices is the correlation between the teacher ratings (Vari- 
able 7 in Table 28) and the post score on the achievement battery (Vari- 
able 10). This correlation is about .65 for both groups. Notable for 
its absence is a similarly strong relationship between teacher ratings 
.^be achievement change score (Variable 13) . These differences sug- 
gest that (1) teachers appreciate high achieving pupils and rate them 
positively and (2) teachers are l;.^ss likely to appreciate children whose 
achievement is changing and therefore rate them less positively, perhaps 
because they create more difficult problems for the teacher. 




The correlation between the teacher rating and th'^ pupil's score 
on interpersonal feelings (Variable 7 vs Variable 12) tends to be higher 
foi’ both Follow Through and non-Follow Through than the correlation be- 
tween teacher rating and child's attitude toward school (Variable 7 and 
Variable 11). This suggests that child sociability is an important fea- 
ture in the teacher's assessment of the child. 

The ethnic identity score (Variable 2) correlates moderately with 
four different measures among non-Follow Through children; task anxiety 
(Variable 9) , achievement - post (Variable 10) , interpersonal feelings - 
post (Variable 12), and achievement - change (Variable 13). The ethnic 
identity variable does not correlate strongly with any other measure 
among Follow Through children. These differences between the two matrices 
suggest that race is not a viable issue in Follow Through programs which, 
if so, may be interpreted as a positive effect of program implementation. 

Task competence measured in the puzzle situation (Variable 8) cor- 
relates more highly with school attitudes - post (Variable 11) among 
Follow Through pupils than among non-Follow Through pupils. While a 
plausible case can be made for the kinds of behaviors leading to a high 
»-ompetence score to be characteristic of children whose attitudes toward 
school are improving, no obvious reasons can be imagined why the rela- 
tionship should be different for Follow Through and non-Fellow Through 
children. 

The school attitude — post score (Variable 11) and interpersonal 
feelings - post score (Variable 12) correlate with one another and with 
the achievement — post measure (Variable 10) among both Follow Through 
and non-Fellpw Through pupils. For Follow Through pupils, the relation- 
ship between the achievement score and the school attitude score is 
stronger than the relationship between the achievement score and the 
interpersonal feelings score. The reverse holds in non-Follow Through. 
This hints at a more rational relationship between attitudes or feelings 
and achievement for Follow Through than non-Fellow TVirough children. The 
magnitude of the differences among correlations, however, is small and 
these differences may be random. 

Sjeppnd and Third Grade Correlations 

An initial feature of interest in the matrices for Follow Through 
and non-Follow Through pupils at second and third grade is the presence 
of more high coefficients in the non-Follow Thi’ough sample than in the 
Follow Through one. No ready explanation can be suggested for this. The 
mean scores, ranges , and variances are similar from one group to another. 



It may be that there is greater trait variability among the non-Follow 
Through pupils than the Follow Through pupils. Since the measures were 
initially developed by others for use with a representative rather than 
a disadvantaged population, the differences suggest that the non-Follow 
Through pupils are more like the general population of pupils for whom 
the measures were developed initially. 

Among second and third graders, as among kindergartners and first 
graders, the relationship between teacher ratings and the two achievement 
measures (Variables 10 and 13) were similar and a similar explanation is 
suggested. 

As was the case with kindergartners and first graders, teacher rat- 
ings (Variable 7) and interpersonal feelings scores (Variable 12) were 
correlated more highly than teacher ratings and attitudes toward school 
scores (Variable 11) for both Follow Through and non-Follow Through 
pupils. As noted previously, this suggests that child sociability affects 
teacher ratings and, further, that sociability is a more visible quality 
than attitudes tov/ard school . 

The three attitude measures (Variables 6, 11, and 12) correlate 
somewhat more highly with one another among non-Follow Through than Fol- 
low Thro This probably is due simply to the fact that the 

score variances were slightly greater among non-Follow Through 
pupils. 

The correlations between teacher ratings (Variable 7) and the two 
locus of control measures (Variables 3 and 4) suggest the possibiiity 
that teachers appreciate responsible self-punitiveness--'Children who 
accept some blame for learning difficulties. The relationships are 
slightly stronger in non-Fdllow Through classrooms than Follow Through, 
which may reflect a moderating influence by Follow Through. 

The locus of control measures (Variables 3 and 4) also correlate 
somewhat differently with achievement - post (Variable 10) in both groups. 
The acceptance of responsibility for failure score (Variable 4) is a 
slightly better predictor of achievement than the acceptance of responsi- 
bility for success score (Variable 3). 

The ethnic identity measure (Variable 2) tends to correlate some- 
what more strongly with other variables among non-Follow Through children 
than among Follow Through children. This supports the impression gained 
from examining the kindergarten and first grade relationships in which it 
was suggested that race per se is a less viable factor in Follow Through 
classrooms. 
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The correlations between the attitude toward school measure obtained 
with the "in My Classroom" instrument (Variable 6) and the two shorter 
^^^itude scales (Variables 11 and 12) tend to be low but, for both groups, 
the correlation between Variable 6 and Variable 12 is stronger than the 
correlation between Variabl^i Q and Variable 11. The In My Classroom 
score represented in Variable 6 (Sontains many items from among the 20 in 
the full scale that refer to intra-personal and inter-personal feelings. 
The shorter scales, on the other hand, are more factorially "pure" which 
probably accounts for the greater correlation betv/een the attitude toward 
School score and the interpersonal feelings score than between the In My 
Classroom score and the attitudes toward school score. 
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Appendix 1 



DEFINITIONS OF POVERTY 



This appendix presents the "index of Poverty — The Poverty Line" 
exactly as appended to the Follow Through Program Guidelines dated Feb- 
ruary 24, 1969, and then describes the "SRI Poverty Categories" derived 
from the parent interview data (see Appendix 6) and used throughout the 
analyses. 



Index of Poverty — The Poverty Line 

OEO has extahlished a "poverty line" index for determining eligibility 
of children for Head Start. This same index will be used for Follow 
Through. The chart below shows , by household size and levels of gross 
income, those families which are considered to fall below the poverty 
line. 



OEO Poverty Guidelines for FY 1969 
Family Size 



1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 



Non-Farm 


Farm 


$1,600 


$1,100 


2 , 100 


1, 500 


2,600 


1,800 


3,300 


2 ,300 


3,900 


2 , 800 


4,400 


3,100 


4,900 


3,400 


5,400 


3 ,800 


5,900 


4 , 100 


6,400 


4 , 500 


6,900 


4,800 


7,400 


5 ,200 


7,900 


5,500 
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The total family income to be used in determining the eligibility 
of low-income children in Follow Through should be based on the prior 
calendar year, or the twelve months previous to school opening, whichever 
most accurately describes the family's need. 

In order to be considered low-income and, therefore, eligible for 
the full-range of comprehensive services in Follow Through, a child must 
either (l) have met the above poverty criteria at the time of entrance 
to Head Start or a similar quality preschool program or (2) meet the 
above poverty criteria at the time of entrance to Follow Through. Such 
a child remains eligible for Follow Through services unless the family 
income rises $3,000 above the applicable poverty line. 

Children from a family that is on welfare are considered eligible 
even though the family income may exceed the poverty line. 



SRI Poverty Categories 



Six ranges of annual income were used in the parent interview. The 
number of categories was limited since there were fears that any more 
detailed questioning about income would meet with negative reactions from 
the respondents (in practice, such fears proved to be largely unjustified) 
These six ranges overlap the OEO "poverty line" index for Fiscal Year 1969 
as appended to the Follow Through Guidelines, and therefore operational 
definitions were developed for classifying the respondents into three 
poverty groups, as shown below in terms of the number of people in the 
family (household) : 



Total Annual 
Income 
(dollars) 



Certain Poverty Possible Poverty 

Farm Non-Farm Farm Non-Farm 



Not Poverty 
Farm Non~Farm 



^$1,000 


^1 


S=1 


$1,000^2 ,999 


S4 


S3 


3,000-4,999 


^8 


S7 


5,000-7,499 


^13 


sii 


7 , 500-9 , 999 


^17 


S15 


10,000+ 


^21 


SI 9 









— 


2-3 


2 


1 


1 


4-7 


3-6 


^3 


^2 


8-12 


7-10 




S6 


13-16 


11-14 


^12 


sio 


17-20 


15-18 


^16 


^14 



The 'Certain Poverty" group includes all respondents whose family incomes 
fall below the OEO’ s 1969 poverty line and the "Not Poverty" group 
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includes all those with incomes above the poverty line. "Possible 
Poverty” signifies, as its name implies, the respondents whose household 
incomes possibly meet the OEO def inition“---the respondents remaining , who 
could not be classified unambiguously under "Certain" or "Not." 
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LIST OF PROJECTS AND DATA COLLECTION ACTIVITIES 
(Fall 1968 to Spring 1970 ) 
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LIST OF PROJECTS AND DATA COLLECTION ACTIVITIES 
(Fall 1968 to Spring 1970) 
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Stewarts Point, Calif. 
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LIST OF PROJECTS AND DATA COLLECTION ACTIVITIES (continued) 
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LIST OF PROJECTS AND DATA COLLECTION ACTIVITIES (continued) 



O 



c 

o 

a 



55 
to 

o ^ 
u 



c: 

40 a. 
CO 



i 


X 

4-J 


Q) 


S 


-ri 


CO 


O 


P 


CQ 


O 


P 


CJ 




s 





•TS 

a 

rn 



§ ° 
2 S 



€ 

C 

o 

cn 

OT 









P 


1 


a 


cts 


a. 




o 


O 


X 


d> 


ni 


CO 




CO 










n 






O 


> 




p 






p; 


p< 






CO 


CO 






o 












d> 


o 

•a 


•rH 

cq 

P 






-rS 


P 


p 


o 


O 


CL 


cq 

a> 


•a 

o 


«rS 

+5 


CO 


B-* 


c«' 


CO 

Q> 








a 








O’ 














^' 


, ov 






p 

a 

-C-. 


Cn 


u 




P 


Pi 




CQ 


0> 


CO 




Pi 


-l-> 

P 








X 



X X 



X 



X 



X 



X 



X 



X 



X X 



X 



a 

d> 

g 

P* Cifi 
d> a 
•n •»-< 

U CQ 
d> 
E-* 



P* 

P 

Pi 



Spr 


70 


r-i 




r-i 


O 


P 


CD 


P4 




Spr 


CD 



rH 00 
CP 



X 



XXX 



X 



X 



X 



X 



X 



X 



X 



X 



£ d> 

5) *5 

s' P* 

^ <s 

Pi 



p. 

CO 



w 



X 



X X 



X 



X 



X X 



X 



X 



>< 



X 



X 



X 



4-> 

o 

d> 

•r-5 

o 

Pi 

no 

P 

CO 

O 

V2 

P 

o 

Pi 

CO 



Pd 

o 



o 

0 

1 

to 



§ 



§ 

13 

CO 

i 





X 

X 

o 

u 




CO 


o 




■< 


iQ 


►-3 


CO 


cn 






a 






<i> 





Iz: 




• 


o 

HH 


o 


p 

p 

a 




o 


t-i 


g 


o 


q 


cd 

o 


1 


f— H 


o 

go 


<u 


•ri 

> 

.P 

cn 



CO 



o 







- 


r-H 




















rH 


r— < 


rH 








cd 


o 








rH 


HH 


rH 




• 


X 


Pi 


« 


HH 




• 


H-l 




HH 


o 


o 


4J 




K-4 


HH 




cn 










■ 


S 


cn 








p 




HH 




PO 




a 


V 




X 




Ct3 


HH 


HH 




o 




o 


r£l 


X 


+J 


* 




HH 


1— i 


HH 




•> 


o 






•H 


o 












0> 




o 




o 




•* 


o 


o 


O 


►>*3 


Q) 


cn 


4^ 






•* 


cd 


tc 


bn 


bn 


o 




cn 


*d 


K-4 


cn 


a 




cd 


cd 


cd 


o 


O 


CD 


•P 


CO 


cd 


o 


CP 


o 


o 


O 






H 


c 




cn 


Ih 


Pi 


•rH 


•cH 


•cH 




Q> 


> 


4-”’ 


g 


p 


X 


o 


»P 


»P 


4P 




XJ 


Cd 


cd 


cd 




E-* 


O 


o 






O 


Q 


X 


OT 


X 



M 

« 



CO 

ca 






o 

CO 



CO 



+J 

P 

P 

o 

o 

p 

o 

CO 

T3 

•rH 

> 

cO 

P) 



CO 

CO 



CO 

Pi 



X 

4-J 

•H 

CJ 



O 

P-^ 

(D 

jz; 



o 

ERIC 



1’27j 



W3 



•a 

o 

p 

rH 

O 

c 

o 

o 



c/a 

M 



E-» 

I— I 

> 



Q 



§ 



E-» 

O 



8 

< 

Q 



O 

§ 

Cm 

o 

c /3 



C 

o 



0) 

> 


bo 




•H 


c; 




4-» 




}h 


•r1 


4-> 


CL. 


C 


CO 


CO 


to 


0> 




o 


H 




o 







I 00 



i 


+-> 


0) 


-o 


B 


•H 


•Ji 


O 


C3 


a 




o 


P 

£ 


O 


CO 



s 2 



>c 



I CO 



B 

o 

o 

;-l 

Ui 

Ui 










Eh 


Eh 


1 




CO 


a 


c< 


o 


O 


CO 


c; 


•H 


CO 




to 


-V> 








C 3 






o 




HH 


J-l 






a: 


p. 






CO 


CO 














Eh 




u 

d> 

JIS 


(U 

T 3 

VH 


*rH 

CO 

c 

c 


Eh 


u 




o 


P* 


ca 

O 


73 

gj 


*H 

4 -> 


CO 


E-^ 


CO 


to 

<0 
















cy 





I S 



X 



o> 

00 



P* s 



X 






lo 

CO 



Q> 

S t 

Q> 



> 

Q> 

•H 

A 

o 

<r 



3 

P 4 



^ 2 
w 



r--l 0> 
CO i£> 
U4 



w ^\ 



rH 00 

CO CO 



X 



X 



X 



CO 



lO 

Oi 



o 

m 



CO 

m 



bo *2 

2 I 

Ph 



^ S 



CQ 



CO 



X 



X X X X 



X 



X 



X 



m 



m 

o 



+j 

cj 

CL* 

•fO 

o 

Ph 

XJ 

c: 

CO 

Js 

o 

CO 

p 

o 

o< 

CO 





* 




, 










• 




-iH 














'iH 


rH 


'H 










'H 


i-l 


cO 


rH 










rH 


cO 


o 


CO 










cO 


o 


o 


• 








o 




•• 


<H 










*» 


>H 


•H 


•H 










HH 


hH 


> 


rH 








IH 


HH 


HH 


►H 


CO 

o 












>% 








■ 




-»-> 










• 




•H 


•H 


-H 


-H 


o 


. 


CH 


■H 




a 


o 


O 


-»-> 




•H 


rH 


to 








pH 


•H 


rH 


CO 


t/} 


to 


CO 


< 


rH 


CO 


O 




Oi 


0 ) 


<D 




CO 


o 




rH 


cH 


pH 


rH 


o 


o 




•H 


o; 


<U 


(0 


dr 


rH 




•« 




hJC 


bO 


bO 


bo 


CO 




T 3 


CO 


a 




C 


P 


pH 


H-> 


P 


o 


< 


< 


C 


C 


c 


CO 














o 


rH 




to 


CO 


CO 


CO 


CO 


£ 


A 5 


tn 


.3 


5 


Q 

►H 


o 

k 1 


CO 

pp 


CO 


CO 

O 


CO 

CO 



CO 

O 



cO 

P 

CT 

to 

CO 

cu 

c 

CO 



c: 

<u 

> 

s 

u 

o 

JJ 

Sm 

•H 



»-3 

g 





CD 




CD 




c -o 




«H 




•H CD 




S" 




rH -M 












CO 




S 




to 




H *t0 
















?S to 
O Eh 
rH O 

CD ^ 




40 

to 












o 




•r>» 




■g . 




to 

G 




H o 




xa 




to 

•H I 




CD 




rH 








CO 




40 




CO 

H rH 




G 




O 

CD E^ 




-H 




•r^ <H 




40 




O 




O 




Eh 

P. ho 




G 




-i 




to 








(D 




• Eh 




4-> 




Cn J3 




*H to 




CO H 




to CD 




1 




40 




00 ^ 




X *H 




CO o 




•H to 




Oa iH 
rH rH 




to 




O 




to X 




to Pm 




O *H 




a 




•a to 




•H O 




s 




Eh +-» 




rH (31 




:3 ^ 




o to 




T3 > 




G Cl 




0) 




•rH iH 




Eh a 

o 




00 rH 




{/i CD 




to rH 




E3 Eh 




C31 cO 




O CD 




rH 




C/) 




rH Eh 




CD 




pH O 




»o 

Q> CD 




CO «H 
Pm 




+-» 




73 




cO H-» 




Eh C 




O 




O CO 




•H SH 




EH 




T3 O 








a 




(D CD 




•H CD 




G rH 




£ 




•H P« 




CD O 




rH B 


• 


CO 




cS 


CO 


4-’ 




to 


'O 


« ^ 




to 


• H 


Xj 0> 




a 4-> 


Eh 


. H-» H-> 


. 


rH CO 


O 


O -H cO 


Cl 


x: 


rH 




0 

1 


CD 40 


pH 


1 


x: 




O -rt 5H 

to J) CD 


00 


4-> G 




to 


•H 


o 


ca +-» +-» 


d 


G 




r-* CO CO 


tH 


O 40 




•H rH 




O 




G O 


G 


E^ G 


•ri 


•H O CO 


•r4 




to 


<0 




O CO 


El 


CD to 4» 


CD 


x; CD 


<D 


rH CO 


pH 


t/l 40 


> 


fX 


PE 


•rl 


•H 


£ CD E« 


£ 


rH to 


C 


CO Eh O 


cO 


cO 




to CD CO 


c/> 


+-> CD 




^ C 




O (D 


•H 


>> o 


>» 


HO G 


Eh 


73 CD pu 


73 


XJ 


CO 


3 C to 


3 


hD 40 


O 


40 -H 


+-» 


G 


CO 


w ^ ^ 


to 


•H t/l 
+-» CD 


H-> 


O CD 4-> 


a 


to 73J 


Eh 


•H .d CO 


•H 


CD G 


d> 


to +-> O 


to 


E-« rH 


,Q 


CO -HO 


CO 


O 


O 


CD T3 


X3 


C 


CcJ 


> G 1 




G .H 




HH O -H O 


»H 


CD 




cc: XI ^ to 


CiJ 


£ 40 


Eh 


c/a co c> Cl 


CO 


03 *H 


C» 


in 

ed. 

th 
n 1 


G 


> 

CD <31 


>1 


•H 


•iH to 




, •> O *H 




XO C31 




'O to -»-> 

Q5 -H D- 


"S 


O iH 
<i: 


O 


•a rH 'O *H 

P 25 XJ 


TJ 


bx) 


»H 


G 


rH C 


•H 


rH to 'a to 


rH 


•iH *H 




o -E> TJ Eh 


o 


O. Eh 


> 


C C3 CO O 


G 


G G* 


Eh 


•H CD to 


*H 


Ph CC 


Q) 


*r^ <D G 






CO 


4-> O Eh O 




CD Eh 




O Eh 0) p. 


O 


X2 O 


O 


5z; Ph ^ to 


J2: 


£h 4H 


“H* 44- H- 




* 



* 




178 

194 



Appendix 3 

LIST OF SPC'NSORS AND ADDRESSES 




185 



Apijendix 3 



LIST OF SPONSORS AND ADDRESSES 



A list of program sponsors for the 1968-70 period, with their current 
addresses, is provided in this appendix. An indication is given of whether 
the program was at a developmental stage or a more matured stage ("first cohort") 
in each school year within the period. 

Develop- Develop- First 

mental mental Cohort 

Program Sponsors and Addresses 1968-69 1969-70 1969-70 

Approaches based on IPI and primary education project X X 

Dr. Lauren Resnick and Dr. Warren Shepler 
Learning Research and Development Center 
Univeisity of Pittsburgh 
160 N. Craig Street 
Pittsburgh, Pa. 15213 

Bank Street College of Education approach X X 

Mrs. Elizabeth Gilkeson 
Bank Street College of Education 
216 W. 14th Street 
Hew York, N.y. 10011 

Behavior analysis appro'^ ch X X 

Dr. Donald Bushell, Jr, 

Support and Development Center for Follow Through 
Department of Human Development 
University of Kansas 
Lawrence, Kans . 66044 

Behavior-oriented prescriptive teaching approach X 

Dr. Walter Hodges 

Southwest Center for Early Childhood Personnel 
Development 

State College of Arkansas 
Conway, Ark. 72032 
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Develop- Develop- First 
mental iriGntal Cohort 
Program Sponsors and Addresses 1968-69 1969-70 1969-70 



Cr^lifornia process model X 

Mrs. Ruth Love Holloway 

Division of Compensatory Education 

Bureau of Program Development 

California Stare Department of Education 

721 Capitol Mall 

Sacramento, Calif. P5814 

i r^gnitively oriented curriculum model X X 

r»1r. David Weikart 

Higtr/Scope Educational Researc Toundation 
125 N. Huron Street 
Ypsilaiiti, Mich, 48197 

Cultur;;*.! linguistic approach X 

Dr, Nancy Amez 

Center for Inner City Studies 
Northeastern Illinois State College 
700 E. Oakwood Boulevard 
Chicago, 111, 60653 

Education Development Center approach X X 

Mr. Frank Watson 
Education Development Center 
55 Chapel Street 
Newton, Mass. 02160 

Florida pa-,*ent education model X X 

Dr. Ira Gordon 

Florida Educational Research and Development 
Council 

College of Education 
University of Florida 
Gainesville, Fla, 32601 

Hampton Institute nongraded model X 

Dr. Mary Chri an 

Department of Elementary Education 
ilampt Institute 
Hampton, Va , 23368 
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Develop- Develop- 
mental mental 

Program Sponsors and Addresses 1968-69 1969-70 



Home-school partnership: a motivational approach X 

Dr, Edward Johnson 

Southern University and ASM College 
Southern Branch Post Office 
Bgi.ton Rouge, La, 70813 

Interdependent learner model X 

Dr. Lassar Gotkin 

Institute for Developmental Studies 

School of Education 

New York University 

Washington Square 

New York, N.Y. 10003 

Language development —bil ingual education approach X X 

Mr. Juan Lujan 

Southwest Educational Development Laboratory 
Suite 550, Commodore Perry Hotel 
Austin, Texas 78701 

Mathemagenic activities program X X 

Dr. Charles Smock 

Division of Educational Research 
School of Education 
University of Georgia 
Athens, Ga . 30601 

New school approach 
Dr. Vito Per rone 

New School of Behavioral Sciences in Educat ion"^'’ 

University of North Dakota 
Grand Forks, N. Dak. 58201 

Parent implementation approach 

Mr. Preston Wilcox 
Afram Associates, Inc.^^ 

103 E. 125th Street 
New York, N.Y. 10035 
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Program Sponsors and Addresses 



Deve?.op- Develop- 
mental mental 
1968-69 1969-70 

Responsive environment approach X 

Dr. Glen Nimnicht 

Far West Laboratory for Educational Research and 
Development 
1 Garden Circle 
Berkeley, Calif. 94705 

Responsive Environments Corporation model X 

Mrs. Ruthe J. Farmer 

Responsive Environments Corporation 
1025 Connecticut Avenue, N.W. 

Washington, D.C. 20036 

i^ystemat ic use of behavioral principles program X 

Mr. Siegfried Engelmann 

Dr. Wesley Becker 

Department of Special Education 

Follow Through Project 

University of Oregon 

Eugene, Ore. 97403 

Tucson early education model X 

Dr. Joseph Fillerup 

Arizona Center foi* Early Childhood Education 
University of Arizona 
1515 E. First Street 
Tucson, Ariz. 85719 



New sponsorj, 1970-71. 
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Appendix 4 

PUPIL Achievement test battery 



in. = ti„en anr- 

each academic year. After each ad ton, in the Fall and Spring of 

refined and aug^men^ed irii^nrorr^^ru"::"’ 

nor wL“^'ntervi'e:ed7rr:t"Lm1t'r each spon- 

underlying sponsors' models tiL-oLrd^^^^ descriptions of the theories 
tional procedures and techniques, tests aL'^otr^'^^ instruc- 

that sponsors expected to use, and other similaritemr""'""”'' 

convened. In attendance^wlr^ mos^^spoL’ ^ Planning conference was 

tatives. OE staff, SRI staff. anroJheri^t a" ff " represen- 

tial portion of the conference ui« ^r inteiested persons. A substan- 

discussion of procedures considered Problems of measurement and 

these discussions evolved Htr^Wv ^nr sponsors. Out of 

with general agreement among all spLsors would "*^^sures that met 

measures derived from tests suggested directly by^eacrspoL^or additional 



The 1968-69 Test Batter.^ 



Nine existing tests were selection ^ 
items. These tests were: ^^^^^ed to comprise a pool of core test 

1. Lee-Clark Reading Readiness Test 

2 . Metropolitan Readiness Test 



3 . 
4. 



Pj?Gscliool Inven'toi'y 

Six tests — Pre-Mathematics, Pre-Science u 
Names, Alphabet, and Numerals— from the 

tories Project of the Insti■^ll■^ -p ^ y Childhood Inven- 

Vork University. for Developmental Studies , New 
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The nine tests were stratified according to subtests or parts de- 
fined by the test publishers or makers . Three versions , later identi- 
fied as the A, B, and C forms, were drawn from the pool of items in these* 
nine tests and were combined into five booklets for classroom administra- 
tion. The rationale for creating three forms of the basic battery was 
to provide broad coverage without exposing any one pupil to excessive 
testing. Collectively, the three versions of five booklets contained 
334 different items. Forms A, B, and C each contained a total of 128 
items; 34 items appeared in some pair of forms (A-B, A-C , B-C) or in 
all three forms (A- B-C) . 

In the actual administration of the basic battery, pupils were as- 
signed randomly to an A, B, or C group, denoting the form of the battery 
to be administered to them. All but one of the booklets were administered 
to groups of seven pupils at a time or, if conditions permitted, to as 
many as nine pupils. The remaining booklet required individual adminis- 
tration . Testing was conducted in each classroom by a tester paid and 
trained by SRI. Each tester, in turn, had either twe or three aides to 
assist him. 



Mid-year Revisions of the 1968-69 Battery 



lu planning for testing in the Fall of the 1968—69 school year, it 
was felt that the basic (core test) battery would be litable for both 
kindergarten and first grade pupils. The fall test a, however, indi- 
cated that the basic battery did not provide adequat ange for first 
graders. This was particularly true in Booklet 1 (j -Clark), Booklet 3 
(NYU. Pre— Mathematics , Pre— Science, Prepositions) ax Booklet 5 (Pre- 
school Inventory),, and to a lesser extent in Bookie" i (I'fYU: Alphabet 

Numerals, Shape Names). 

Booklets 1 and 3 were dropped from the first grade battery for spring 
administration. Booklet 5 was retained despite indications of constricted 
range, to make it possible to develop normative data for Follow Through 
pupils on the Preschool Inventory. In place of Booklets 1 and 3, the 
Word Reading and Paragraph Meaning subtests from the Primary I version 
of the Stanford Achievement Test, Form Y, were substituted. Both these 
latter tests were administered in their entirety (not split into separate 
forms) to complete first grade classes. 
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Development of Supplementary Battery 



As mentioned above, a strategy for obtaining measui’es responsive to 
the particular objectives of individual sponsors called for developing 
tests that contained items submitted by each sponsor. Each program spon- 
sor was asked to contribute test items that he considered valid for the 
program he advocated. In this context, "item" was defined generically 
to include any observable indicator of intended change . Thus , a sponsor 
could submit items for V'hich the appropriate mode of measurement might 
be direct obsei’vation of operating classrooms or interviews with parents 
or school staf.^ . Specification of a desired social act by a pupil in a 
naturalistic situation would, therefore, be as properly considered an 
item as would a question about symbol discrimination in a paper-pencil 
test . 



Items were not obtained from all sponsors; however, a total of ap- 
proximately 1,500 items were submitted by nine of the sponsors. Items 
were classified according to content and sorted into those suitable for 
administration as classroom test items and those better suited for use 
in classroom observation schedules or interviews with instructional staff 
or parents. This sorting left approximately 1,000 items in the test item 
pool. Of this number, approximately 40 percent were excluded for one or 
more of the following reasons: (1) the question duplicated very nearly 

or exactly some question already embodied in the basic battery, (2) use 
of the question required training in individual testing, e.g., for the 
Wechsler Preschool and Primary Scale of Intelligence, or (3) administra- 
tion demanded the use of elaborate materials or idiosyncratic procedures 
that would be too cumbersome for use without close professional super- 
vision. As had been the pattern in developing the basic battery, the 
remaining 600— odd items were stratified by content and sponsor, and three 
unique forms or versions were constructed by randomly allocating equal 
numbers of it«ms from each cell to each form. 

The tests were pretested with Follow Through and non-Follow Through 
kindergarteners and first graders in a San Diego school excluded from the 
evaluation sample. Following analyses of these trials, some alterations 
were made in instructions for administration and a few items were reas- 
signed to increase form— to— form similarity on test difficulty. 

The version of the supplementary battery produced in quantity for 
use in the Spring testing was embodied in two booklets , each with three 
forms (A, B, and C) . One booklet (identified as Booklet 6) contained 
items that were administered to groups of six children at a time. The 
other (Booklet 7) contained questions for individual administration. 
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Item Analyses of 1968-69 Tests 



A variety of analyses were performed on results from Fall and Spring 
use of the basic and supplementary bs teries to guide revision and improve- 
ment of the test instruments for 1969-70. As the Fall 1968 results had 
suggested earlier, a major deficiency in the basic battery was the limi- 
tation in range. This was true to some extent for kindergarten but was 
especially marked at the first grade level. Item-by-item examination of 
the battery showed many individual items, and within some tests, whole 
subtests, for which evidences of "topping out" were clear. After review- 
ing intercorrelations and other indicators of item characteristics, it 
was decided that the most important criterion for item exclusion was re- 
striction in the upper range. Accordingly, item difficulty distributions 
were prepared for classrooms grouped according to sponsorship.* if an 
item displayed an average difficulty above .75 for classroom groups from 
four or more sponsors, the item was rejected. If a substantial number 

of items from a subtest met this criterion, the entire subtest was re- 
jected . 



Validity of the 1968—69 Tes t Battery 

It was recognized that the tests assembled or developed for use 
during 1968-69 were not considered equally valid by all appropriate 
judges of curricular validity, such as sponsors and teachers. Counsel 
from sponsors was sought and valued, of course, in the design of the 
battery, but fallible judgments, second thoughts, and changes in program 
design were all possible influences on the curricular validity of the 
tests as actually administered. 

To help counteract these influences, a procedure was developed for 
obtaining post factum estimates of the curricular validity of all the 
items, subtests, and tests used in both the Fall and Spring. The mate- 
rials used in this procedure were distributed in early May 1969. The 
central instrument was basically a questionnaire that asked, with refer- 
ence to each item, subtest, and test, at what point in time a specified 
fraction of pupils in the program were likely to have received instruc- 
tion that would permit them to make a reasoned response— i .e . , not a 
guess to each test question. A procedure generally similar to this had 
been used with encouraging results by SRI staff in two previous projects. 



* Item difficulty is defined as the proportion of correct 
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responses . 



The judgments called for by such a procedure are complex, for at 
least three considerations are involved: (1) probability of exposure 

to requisite instruction, (2) the proportions of students to whom the 
probability estimates refer, and (3) assumptions about the time frame 
within which the estimates apply. 

In the application to the loilow Through study, the procedure was 
simplified. Three groups were asked to assist by responding to the 
questionnaire: (1) program sponsors, (2) samples of classroom teachers 

(both Follow Through and non-Follow Through), and (3) Follow Through 
coordinators and curriculum specialists. Three things were sought: 

(1) a basis for differentially scoring subtests and tests within the 
batteries (potentially, many "weighting keys" could be derived), (2) an 
indication of variability within a program regarding the salience of in- 
structional objectives and their sequencing, and (3) an additional basis 

for estimating the commonality and diversity of instructional objectives 
among programs , 

• second portion of the questionnaire solicited suggestions for 
closing the gaps in the batteries— that is, identifying important cur- 
ricular objectives amenable to test measurement that were not accommo- 
dated in the tests used. Many of these suggestions were influential in 
shaping revisions for 1969-70, 



The 1969—70 T^st Battery 



The achievement test battery used in both the Fall and Spring of 
1969-70 was a refinement and an extension of the battery used the pre- 
ceding year. For example, in 1968-69, only kindergarten and first grade 
pupils were tested. In 1969-70, pupils from kindergarten through the 
fourth grade were tested, thus necessitating five separate . batteries , 

i.e., kindergarten and entering first, non-entering first, second, third 
and fourth grades . 



f 



The primary changes in the substance of the battery were to (1) cull 
items, subtests, and whole tests from the 1968-69 battery that had shown 
celling effects or other weaknesses and (2) add items, subtests, and 
tests to a.3sure a more balanced coverage of quantitative, verbal , 'symbol 
recognition, and other acadamically relevant skills. 

The various batteries were comprised of items and subtests drawn 
from the following: 



ZQo 
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1. Lee-Clark Reading Readiness Test 

2. Metropolitan Readiness Test 

.3. Early Childhood Inventories Project, New York University 

4. Preschool Inventory 

5. Stanford Achievement Test 

6. Metropolitan Achievement Test 

7. The Comprehensive Tests of Basic Skills 

8 . Wide Range Achievement Test 

9. Individual items contributed by sponsors 

Tests were administered to the fourth grade to provide. a basis for 
future comparison. Fourth graders in 1969-70 were the last fourth grade 
children that could not have experienced either Head Start or Follow 
Through. It is planned to test fourth graders in the future who have 

graduated” from Follow Through and make comparisons between the two 
sets of data. 

Although elements of the 1969-70 achievement battery included ques- 
tions dealing with pupils’ attitudes and study skills, most of the pupil 
measures obtained in this battery have assessed performance in tradition- 
ally accepted areas of academic achievement, such as language and compu- 
tational skills. A detailed breakdown of items by grade level and item 
category is provided in Table 4-1. 
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Table 4-1 



ITEM DISTRIBUTION FOR 1969-70 ACHIEVEMENT TEST BATTFRY, 
BY WRAT/NON-WRAt" COMPONEOTS for each grade level TF.iiTED 











Grade 


Level"^ 








Item Category 


K Sc 


E-1 


NE-1 




2 




3 


Number 


Percent 


Number 


Percent 


Number 


Percent 


Number 


Percent 


Non-VVRAT items^ 


Verbal/linguistic 


41 


28.1% 


52 


26 . 7% 


70 


31 .5> 


47 


21 . 0% 


Quantitative/computational 


21 


14.4 


30 


15.4 


45 


•JO .3 


52 


23 . 2 


Perceptual/motor 


0 


0.0 


11 


5 .6 


11 


5.0 


5 


2.2 


Subtotal 


62 


42 . 5% 


93 


47.7% 


126 


56.8% 


101 


46 . 4% 


UTtAT items'^ 


Verbal/linguistic 


42 


28.8 


56 


28.7 


71 


32 .0 


101 


15.1 


Quant i t at i ve/c ompu tat ional 


24 


16.4 


28 


14.4 


16 


7 .2 


19 


8.5 

0.0 


Perceptual/motors 


18 


12.3 


18 


9.2 


9 


4.1 


0 


Subtotal 


84 


57.5% 


102 


52.3% 


96 


43.2% 


120 


53.6% 


Summary 


Verbal/linguistic 


83 


56.8 


108 


55.4 


141 


63 . 5 


118 


66 . 1 


Quantitative/computational 


45 


30.8 


58 


29.7 


61 


27.5 


71 


31 . 7 


Perceptual/motor 


18 


12 .3 


29 


14.9 


20 


9 ,0 


5 


2,2 


Total 


146 


100 .0% 


195 


100.0% 


222 


100.0% 


224 


100.0% 



* \VRAT = Wide Range Achievement Test. 

t K = Kindergarten 

E— 1 = Entering first grade 
NE-1 s= Non-entering first grade 

2 = Second grade 

3 = Third grade 






Sources of Items or Subtests 



Admiiiistex*ed 
to Grades 



5 



Lee-Clark Reading Readiness Test 

NYU Early Childhood Inventories (Alphabet, Numerals) 

P'/eschool Inventory 

Metx'cpolitan Readiness Test (Form A) 

Stanford Achievement Test (Primary I , Form Vt Word Reading) 

Metropolitan Achievement Test (Primary II, Form A: Arithmetic Computation) 

Comprehensive Tests of Basic Skills (Form Q, Level 1): 

Reading Vocabulary and Arithmetic Computation 
Others 

Wide Range Achievement Test (solected items or subtests) 

Achievement Items from Sponsors 

IVRAT items calling for copying marks are classified as perceptual/raotor rather 
spelling (linguistic) set. 



K, E-1 
K, E-1 
K, E-1 
NE-1 , 2 
2 
2 

3 , 4 
4 

All grades 
1, 2, 3 

than as a sub-part of the 
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Appendix 5 



N0N-C0C3NITIVE TEST BATTERY 
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NON-COGNITIVE TEST BATTERY 



A central concern of the SRI project staff, of Follow Through pro 
gram sponsors, of OE /Follow Through staff, and consultants to Follow 
Through and to SRI throughout the history of the project has been the 
inadequacy of measures appropriate to the assessment of non-cogniti ve 
changes in a program characterized by such large numbers of children. 
Development of instruments for measuring non-cognitive variables was 
discussed at several conferences. 

In the fall of 1969, a non-cognitive subcommittee (Drs. Edward 
Barnes, Judy Crooks, Eleanor Maccoby and Ray Rhine) was appointed to 
stimulate and guide the selection, adaptation and development of non- 
cognitive instruments that woul I reflect the goals of Follow Through 

stakeholders, particularly the program sponsors and the participating 
parents and children. 



Sponsor Objective 



The various Follow Through programs differed markedly in their 
relative emphasis on non-cognitive measurement, but all sponsors recog- 
nized that the non-cognitive growth and development of children may be 
significantly influenced by the quality of their educational experience. 
Information concerning sponsor objectives was derived through several 
procedures. SRI staff examined sponsor statements made in program des- 
criptions and in various Follow Through review and planning conferences. 
Joint Fellows, the representatives of the sponsors, were invited to state 
the current non-cognitive objectives of their programs. SRI staff also 
interviewed sponsors on program objectives, including non-cognitive 
objectives. Under the auspices of the Social Science Research Council, 
Drs. Eleanor Maccoby and Miriam Zellner interviewed sponsors on program 
assumptions and objectives. 



The program objectives collected through these procedures clustered 
into the following general measurement areas: attitudes toward school, 

task orientation skills, curiosity and exploration, autonomy, self-esteem 
school fearfulness, and locus of control. 
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Ethnic Minorities* Objective s 

Ethnic minority concerns and recommendations on non-cogniti ve measure- 
ment emphasized that evaluation of pupil change must be closely tied to 
evaluation on institutional change. The following changes in educational 
institutions were recommended: the curriculum and teaching strategies 

should be consonant with the culturally unique learning, incentive, and 
motivational styles of the ethnic minority pupils; parents should have 
greater participation (and power) in decision-making; and administrators 
and teachers from ethnic minority groups should be more adquately repre- 
sented in Follow Through. 

Ethnic minority representatives criticized existing instruments 
because they usually reflected an Anglo middle-class value orientation. 

They recommended the following changes in pupil measures: more research 

must be directed toward understanding the nature of values and non-cogni- 
tive functioning within particular ethnic cultures; the operational defini- 
tion of non-cognitive constructs should be consistent with the values o^= 
ethnic minority communities; verbal and pictorial test stimuli must be 
appropriate to the prior learning experience of ethnic minority pupils; 
and whenever possible, tests should be administered to ethnic minority' 
children by persons from the same ethnic group. 

Ethnic minority representatives opposed educational practices and 
instruments that required or implied that minority pupils should adopt 
Anglo middle-class values and behaviors at the expense of losing or 
rejecting tl. ir identity with their own ethnic group. They contended 
that ethnic (racial, cultural) identity (pride, self-image, awareness) 
should be defined and evaluated as a relevant educational goal. Several 
persons suggested that ethnic identity may be causally related to the 
ethnic minority child's level of academic achievement, self-concept, 

self-esteem, values, and feelings of efficacy and control over the conse- 
quences of his behavior. 

During an OE-SRI meeting in Menlo Park in July 1970, there were 
initial discussions of subcontracting with certain ethnic minority con- 
sultants for the purpose of constructing instruments reflecting the par- 
ticular goals and aspirations of the minorities. Two preliminary pro- 
posals for developing such instruments have been submitted to OE by ethnic 
minority behavioral scientists. 
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I dentif ication of Instruments 



Establishing curricular validity for non-cogniti ve objectives is 
difficult inasmuch as specific non-cogniti ve curricula rarely exist in 
school systems. Non-cogniti ve objectives are frequently stated in the 
°^^^^^Shly generalized labels such as "positive attitudes," "auto- 
nomy," "self-esteem," and so forth. Each of these expressions represents 
a packaging of broad areas of psychological functioning in inefficient, 
loose, and imprecise terms. Moreover, these expressions are not well 
defined in terms of measurement operations. Thus, the task of identi- 
fying instruments acceptable for program evaluation is difficult. 



Several procedures were employed to identify instruments for non- 
cognitive evaluation. Sponsors and the Joint Fellows were invited to 
provide copies of all non-cogniti ve instruments that they used for 
program evaluation f rom . 1968 to 1970 and to suggest other non-cogniti ve 
instruments appropriate for evaluation. Several consulting researchers 
in the areas of child development and early childhood education recom- 
mended non-cogniti ve instruments. The SRI staff conducted a. literature 
search to identify appropriate instruments. 



Review and Selection of Instrument s 

Each instrument was assessed for its relevance to Follow Through 
and for the quai.ity of its methodological characteristics. The eight 
instruments employed in the Spring 1970 pilot study (see below) were 
selected through review procedures that involved members of the non- 
cogn' v.ive subcommittee, SRI consultants (including ethnic minority 
representatives), the Joint Fellows and their sponsors, an 
Several instruments were recommended for field testing in Oakland and 
San Jose. The field testing of instruments, the final selection of 
instruments included in the Spring 1970 pilot study, and the training 
of the pilot study testing teams occurred from February 1 to April 15 
1970. 



The Spring 1970 Pilot Study 

The eight selected instruments were administered in the following 
eight communities: Chattanooga, Duluth, East St. Louis, LaFaystte, 

Miami, Portageville, Tupelo and Tuskegee. Three instruments (Ethnic 
Pictures, Response to Social Influence, and Task Performance Skills) 
were individually administered to 12 pre-selected pupils (6 boys and 6 
girls) in each classroom of kindergarten through grade three. 



Four instruments (Test Anxiety Scale, Intellectual Achievement Responsi- 
bility Scale, In My Classroom, and the Picture Motivation Scale) were 
administered to the entire class in selected classrooms of grades two 

and three. The Classroom Behavior Inventory was a teacher rating instru- 
ment . 



A total of 45 classrooms and 845 pupils were included in the pilot 
study data collection. Some 95% of pupils designated for individual 
testing were tested, and over 90% of the teacher ratings were completed. 
School personnel were cooperative and generally enthusiastic about in- 
cluding non-cognitive instruments in the Follow Through evaluation. The 
instrument administration procedures were generally effective, but cer- 
tain modifications were indicated on the basis of experience in the pilot 
study. 



Data Analyses 



i; 



To determine the operating characteristics of each instrument, the 
following descriptive data analyses were performed for each: means and 

standard deviations, reliability estimates, and standard errors of mea- 
surement. Construct validity was assessed for each instrument and separate 
multivariate analyses of covariance were performed for each of the samples 
for kindergarten and grade one, for grades two .lad three, and for the total 
sample, treating the pupil's age as the covariE 



Results 



The pilot study results suggested that several inst’ ..lents were 
sensitive to systematic program differences for grades two and three and, 
to a lesser extent, for kindergarten and' grade one. The pattern of re- 
sults may reflect the greater difficulties commonly acknowledged in ob- 
taining reliable measures at earlier ages, or the lesser stability of 
program effects at the earlier ages. Reliability estimates for the 
group— admini stered instruments among poor children compared very favor- 
ably with previous estimates obtained for middle-class pupils. Overall 
the number ox significant main effects greatly exceeded chance expec- 
tancy. The differences on the group— administered tests suggest the pos— 
corresponding behavioral differences that could be investi- 
gated in future exploratory and developmental studies. 
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PARENT INTERVIEW SURVEY 




Appendix 6 



PARENT INTERVI?’’" lURVEY 

The parent interview (PI) survey was developed around four major 
purposes: 

(1) To examine the comparability of Follow Through and non-Follow 
Through children, so that any differences found to be signifi- 
cant could be investigated or more comparable subgroups of 
children could be selected for inclusion in the evaluation, 

(2) To determine the effectiveness of Follow Through for different 
demographic subgroups, once comparability between Follow Through 
and non-Follow Through children is established or improved. The 
parents are one of the best sources of information on their own 
education, income, and occupation. Such data can help deter- 
mine whether it is the poorest children, with the least edu- 
cated parents, who are being most effectively reached by Follow 
Through or whether, on the contrary. Follow Through works best 
for those children who already have more economic and educa- 
tional advantages at home, 

(3) To investigate parent attitudes and actions as mediators of th 

effectiveness of school programs. The amo’"-' '' , v given 

in the home to the child’s academic activities, the ‘life style” 
of the family, and the parents' own feelings of self-esteem and 
effectiveness in dealing with schools are strongly emphasized 

in some Follow Through programs as factors that may facilitiate 
a child's readiness to learn. Children can be grouped according 
to such factors and the groups compared for academic achievement. 

(4) To measure parent awareness of, participation in, and satisfac- 
tion with Follow Through. Although there is variation in the 
degree of emphasis on parent involvement in the different spon- 
sor approaches, the Follow Through program as a whole places 
great importance on parent participation. The extent to which 
this goal is being reached can be judged according to informa- 
tion best obtained from the parents themselves on their atti- 
tudes and actions related to Follow Through and other school 
programs. 
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Selection of Respondents 



To provide the basic and interpretive data needed to fulfill the 
above purposes for the 1969-70 school year, over 16,000 target families 
were selected in 49 communities with 65 Follow Through projects under 
20 sponsors. The names were supplied to the National Opinion Research 
Center (NORC) , the subcontractor that did the interviewing. NORC was 
able to locate 15,284 (95%) of the target families, and of those lo- 
cated, to complete a parent interview with 14,833 (97%). The sample 

included most of the projects that had been selected for the 1968-69 
SRI study sample. 

Although a total of 14,833 home interviews were completed, 775 could 
not be correlated with individual pupil measures. Achievement test data 
were not obtained at all for these cases or, if obtained, could not be 

matched with parent interview data in time to be used in the present 
analyses. 

Table 6-1 shows the sample of 14,058 (14,833 less 775) by grade level 
of the child and by type of interview form used (the "long” or "short" form 
described below). For present reporting purposes, the 3,685 parents of 
grade four pupils, interviewed to provide comparisons with present Follow 
Through children when they reach grade four, have been excluded. Thus, 
the final effective sample in the present analyses totals 10,373. 



Development of Interview Forms 



The long form of tlie interview was Jointly developed by OF, SRI, 
NORC, and consultants over a period that extended from late 1968 to la:,- 
1969. Agreement vas reached on the importance of the following subjerT 
areas withi: whie_i the questions were formulated: 

( 1 ) Dv-mographic characteristics 



(2) Ge ieral "life style" and attitudes 

(3) Interest in and knov’ledge about Follow Through 

(4) Kar-ticipation in poTicy making with respect to educational 
programs. 



(5) 



Parent contact with the school and its staff 
Feeliings of efficacy in relation to the school 
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Appendix Table 6-1 

NUMBER OF PARENT RESPONDENTS, BY CHILD'S GRADE 
LEVEL AND INTERVIEW FORM COMPLETED 



Follow Through 


Non-Follow Through 


Total 


Long Short 


Long Short 


Long Short 



Grade 


Form 


Form 


Total 


Form 


Form 


Total 


Form 


Form 


Total 


Kinder. 


2,084 


1,966 


4,040 


1,072 


1,048 


2,120 


3,156 


3,004 


6, 160 


Ent . 1 


941 


751 


1,692 


615 


507 


1,122 


1 , 556 


1,258 


2,814 


Non- 




















Ent . 1 


427 


388 


815 


106 


100 


206 


533 


488 


1,021 


2 


149 


130 


279 


50 


49 


99 


199 


179 


378 


4 


-- 


— 


— 


— 


3,685 


3,685 





3,685 


3,685* 


Total 


3,601 


3,225 


6,826 


1,843 


5,389 


7,232 


5,444 


8,614 


14,058* 



* For present analytical purposes, the 3,685 parents of grade four pupils 
b-ave been excluded, leaving a final, effective sample of 10,373. 



(7) Feelings of being able to control one's life 

(8) Support and guidance of child with respect to educational pro- 
grams 

(9) Extent of educationally relevant stimulation in the home en- 
vironment 

(10) Aspirations for the child's future. 

*]. he short form was used to extend the base for two main types of 
data— demographic, and parents' "life style" and attitudes toward school— 
so that these measures could be compared with other descriptive and evalu- 
ative information, primarily the pupil achievement scores. 
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yield Work 



The field work was directed from NORC’s New York office and conducted 
by NORC with close communication among NORC, OE/Follow Through, and SRI. 

NORC appointed a local supervisor for each geographic location and 
had the responsibility for gaining entry into the community, using ex- 
plicit procedures developed jointly by OE/Follow Through and SRI. 

As a control on quality, NORC checked by phone or mail between 15 
and 25% of the respondents to assure that the interview had taken place, 
the percentage varying in the different areas. The selection of inter- 
views for this validation was random except that the first few interviews 
by each interviewer were validated. In addition to verifying the original 
interview and the answers to a few key questions in it, NORC asked some 
questions about the respondent's reaction to the interview. In spite of 
the high response rate— interviews were completed with 97 percent of the 
».aren.s located —there were very few negative incidents or reactions 
to the survey, considering its very large size. 



Data Processin g 

The completed interview forms were coded at NORC in accordance with 
specifications jointly developed by SRI and NORC. The codes for most of 
the open-ended questions were also jointly developed by SRI and NORC 
staff, at a meeting in New York. Two open-ended questions concerning 
the parent s likes and "dislikes" about Follow Through were specifi- 
cally excluded from coding by NORC under its contractual time schedule. 
Instead, a sample of these responses was coded by SRI. 
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TEACHBB AOT3 AIDE QUESTIONMAIRes 



as axiomatic that 

- the teacher, ^nZTtZT"" instruction 

a guide, resource persOT^^ “ultiple roles in interaotiorw-‘'?h ‘=°"nse, 
vary m their assuLt knowledge and PnPH- 

tne learning Z tT Z ZZZZ, 

nettings vary according to t“nctions. in addition , PPPiln- 

-tlahle and the uses^o - -our^c^ 

Measuring some of t-v. 

n teacher auest evaluation project ^ an important 

nan questionnaire. °ne technique used „as 

both iaterLr'anl^fxteJnll^rr'’™®"’' 

Of 1970. ^'^''nl review and was administererd following 

nistered during the Spring 

ooverj:;^ ::::::r r:;::r“ih: (aome 

(educatL" 

/ ®^Peraence) y 

Classroom practices 

( ) Availability and use of • 

^ equapment and materials 

Educational goalc? -f 

goals for children 

(s) Information and atti t,i^ 

participation in the ci::s:ol“‘ P«ent 
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(e) Knowledge about Follow Through, manner of involvement 
in the program, and opinions about its effectiveness 

( 7 ) General assessment of pupil progress. 

A shorter ( 19 questions) but related questionnaire was given to class- 
room assistants or aides. It included: 

( 1 ) Demographic and background information 

( 2 ) Manner of becoming an aide 

( 3 ) Training 

( 4 ) Activities 

( 5 ) Opinions about Follow Through 

(e) Opinions about the teacher. 

Within the overall evaluation plan, information about teacher 
characteristics and attitudes and classroom practices derives from 
two complementary sources; these teacher and aide questionnaires and 
systematic classroom observations by outsiders. Since the latter 
included observations of the pupils and of their interactions with 
teachers and aides, a self-reporting questionnaire was employed for 
the teacher survey. Responses were received from approximately 90% 
of the Follow Through teachers and 80% of the non-Follow Through 
teachers in the sample.- These data were obtained primarily for the 
purpose of exploring the relationships between teacher characteristics, 
attitudes and classroom practices, and pupil development. 
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tne scnools. If the parents disagree with 
the teacher or principal, there’s nothing 
parents can do about it. (2 items com- 
bined, recoded to 2-leveI variable: 

1 = not helpless; 2 = helpless) 
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